Big Data Developer

Hiring: Data Engineer/ Big Data Developer

Location: Chantilly, VA (100% Onsite)

Employment Type: Full-Time

Security Clearance: Active CI Polygraph Required

Working Hours: 9:00 AM – 3:00 PM EST

Bonus: Performance-Based

Job Summary

We are seeking an experienced Data Engineer with 10+ years of software development/programming experience to design, develop, and optimize large-scale data ingestion, ETL, data transformation, and processing solutions in a Big Data environment.

Key Responsibilities & Required Skills

• Design and optimize large-scale data ingestion, ETL, data extraction, cleansing, transformation, and data loading pipelines.
• Strong programming experience in Python and/or Java, with advanced SQL and database knowledge.
• Hands-on experience with Python technologies, including environment management, asynchronous development, FastAPI, and REST APIs.
• Experience with Big Data environments and the complete data lifecycle, from data ingestion to visualization.
• Strong experience with Apache Airflow, ETL development, and Linux-based environments.
• Develop data profiling, deduplication, matching logic, and custom data integration solutions.
• Leverage Big Data for AI/ML-based analytics and collaborate with Data Scientists to support AI/ML workflows.
• Maintain data layer documentation and perform basic Linux server administration.

Preferred Skills

• Experience deploying AI/ML-enabled solutions.
• Experience creating and publishing BI dashboards.

Minimum Qualification: High School Diploma/GED with 10+ years of relevant software development experience