Embark on an exciting journey into the realm of data engineering and architecture with 3Pillar! We extend an invitation for you to join our team and gear up for a thrilling adventure. As a Data Architect you will be at the heart of the organization and support our clients to take control of their data and get value out of it by defining a reference architecture for our customers. This means that you will work closely with business leaders and information management teams to define and implement a roadmap on data architecture, data management, business intelligence or analytics solutions..
Minimum Qualifications: Translate business requirements into data requests, reports and dashboards.Strong Database & modeling concepts with exposure to SQL & NoSQL DatabasesStrong data architecture patterns & principles, ability to design secure & scalable data lakes, data warehouse, data hubs, and other event-driven architecturesExpertise in designing and writing ETL processes in Python / Java / ScalaUnderstanding of Hadoop framework - Exposure to PySpark, Spark, Storm, HDFS, HiveStrong hands-on experience with either Databricks or Snowflake; experience with both is desirable.Knowledge of Master Data management and related toolsStrong exposure to data security and privacy regulations (GDPR, HIPAA) and best practicesSkilled in ensuring data accuracy, consistency, and qualityExperience with the AWS/Azure/GCP data engineering servicesKnowledge of AWS services viz., AWS S3, Redshift, Lambda, DynamoDB, EMR, Glue, Lakeformation, Athena, Quicksight, RDS, Kinesis, Managed Kafka, API Gateway, CloudWatchAnd / ORKnowledge of Azure services viz., ADF, Data Catalog, Databricks, Azure Synapse Analytics, ADLS Gen2, Azure DevopsAbility to implement data validation processes and establish data quality standards.Experience in LinuxProficiency in data visualization tools like Tableau, Power BI or similar to create meaningful insights Additional Experience Desired: Experience working with data ingestion tools such as Fivetran, stitch, or MatillionAWS IOT solutionsApache NiFi, Talend, InformaticaExposure to AI / ML technologies