ETL Data Engineer

Company: Go Intellects Inc
Location: Washington
Posted on: January 28, 2025

Job Description:

Benefits:

• Competitive salaryThe Enterprise Data team at Client requires an ETL data engineer to support data operations for its Cloud Data Exchange. The resource will utilize native Azure tools to perform ETL, data loading, and data transformation tasks.Complete Description:The ETL data engineer will support the Client Enterprise Data team for data curation, processing, and transformation tasks. Specifically, the ETL data engineer will be responsible for the following tasks:Responsibilities:
• Analyzes, designs, develops, implements, replicates, and supports complex enterprise data projects.
• Interfaces with other agencies, consults with and informs user departments on system requirements, advises on environment constraints and operating difficulties for the current state, and resolves problems using cloud solutions while developing and replicating future enhancements to the District's data systems.
• Strong knowledge of Extraction, Transformation and Loading (ETL) processes using frameworks like Azure Data Factory, Synapse, Databricks, Informatica by gathering requirements from stakeholders or analyzing existing code and performing enhancements or new development.
• Establishing the cloud and on-premise connectivity in different systems like ADLS, ADF, Synapse, Databricks.
• Hands-on experience in Azure cloud services like Azure Data Factory or Azure Synapse, MSSQL Db, Azure SQL DB, Azure Data Lake Storage Gen2, Blob Storage, Python, etc.
• Worked on creating end-to-end pipelines to load data by reading it from multiple sources or source systems and loading it to the landing layer or SQL tables.
• Familiarity/experience with data integration and data pipeline tools (e.g., Informatica, Synapse, Apache NiFi, Apache Airflow).
• Familiarity/experience with various data formats including database-specific (Oracle, SQL Server, DB2, Quickbase), text formats (CSV, XML), and Binary (Parquet, AVRO).
• Develops, standardizes, and optimizes existing data workflows/pipelines adhering to best practices.
• Adheres to and contributes to enterprise data governance standards by ensuring data accuracy, consistency, security, and reliability.
• Automates, monitors, alerts, and manages data pipelines and workflows.
• Analyzes and evaluates system changes to determine feasibility, provides alternative solutions, and back-up and rollback procedures.
• Works on the development of new systems, upgrades, and enhancements to existing systems ensuring systems follow approved standards and consistency after the changes.
• Develops complex programs and reports in database query language.
• Familiarity/experience with data visualization tools.
• Familiarity/experience handling and securing sensitive data based on the level of sensitivity.
  #J-18808-Ljbffr

Keywords: Go Intellects Inc, Towson , ETL Data Engineer, Engineering , Washington, Maryland