HYBRID - 3 DAYS ONSITE PER WEEK - WASHINGTON D.C.
Data Engineer III
Overview
Seeking a Data Engineer III to join the data team supporting a high-priority initiative focused on building the foundation for enterprise knowledge management. This role will focus on developing and enhancing scalable data pipelines while also contributing to the evolution of the underlying data structure and knowledge framework supporting the initiative.
Key Responsibilities
- Design, develop, and enhance data pipelines to ingest data and documents from various source systems into the enterprise data lake.
- Work with stakeholders to identify data from source systems and ensure reliable ingestion and storage within the data lake environment.
- Build and optimize pipelines to capture additional documentation and knowledge artifacts as part of the initiative.
- Implement and manage data orchestration using Azure Data Factory (ADF).
- Utilize dbt to perform transformations and improve data structure for downstream consumption.
- Enable data workflows through Databricks and Unity Catalog, ensuring proper metadata management and governance.
- Contribute to the development of taxonomy and data organization frameworks to support searchability and reporting.
- Partner with stakeholders and technical teams to help establish a unified knowledge interface that improves access to enterprise documentation and project data.
- In addition to hands-on engineering work, evaluate existing data structures and identify opportunities to enhance them for future needs, ensuring knowledge and document structures can scale across the organization.
- Help establish context and structure for enterprise documentation and data assets, enabling more effective extraction and use of knowledge by stakeholders across the enterprise.
Required Qualifications
- 8+ years of experience in data engineering or related roles.
- Strong experience with Azure Data Factory (ADF) for pipeline orchestration.
- Hands-on experience with Databricks in data engineering environments.
- Experience using dbt for data modeling and transformation.
- Strong proficiency in Python, particularly for scripting and pipeline development.
- Experience building scalable ETL/ELT pipelines and managing data ingestion workflows.
- Strong understanding of data lake architectures and metadata management.
Preferred Qualifications
- Experience designing data organization frameworks or taxonomy structures.
- Exposure to knowledge management or enterprise document repositories.
- Experience working with structured and unstructured data sources.
Dexian stands at the forefront of Talent + Technology solutions with a presence spanning more than 70 locations worldwide and a team exceeding 10,000 professionals. As one of the largest technology and professional staffing companies and one of the largest minority-owned staffing companies in the United States, Dexian combines over 30 years of industry expertise with cutting-edge technologies to deliver comprehensive global services and support.
Dexian connects the right talent and the right technology with the right organizations to deliver trajectory-changing results that help everyone achieve their ambitions and goals.To learn more, please visit https://dexian.com/.
Dexian is an Equal Opportunity Employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status.