Data Engineer (All Levels)

Benefits: - Retirement Plan - 401(k) - 401(k) matching - Bonus based on performance - Company parties - Competitive salary - Dental insurance - Health insurance - Opportunity for advancement - Paid time off - Training & development - Vision insurance Job Description Silverthorne Advisory Group is seeking a skilled and highly motivated Data Engineer to join an exciting and growing opportunity within the Defense sector. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our Advana data infrastructure and systems. Your expertise in ETL, Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks will be essential in ensuring efficient data processing and analysis. Responsibilities - Design, develop, and implement end-to-end data pipelines, utilizing ETL processes and technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks. - Create and optimize data pipelines from scratch, ensuring scalability, reliability, and high-performance processing. - Perform data cleansing, data integration, and data quality assurance activities to maintain the accuracy and integrity of large datasets. - Leverage big data technologies to efficiently process and analyze large datasets, particularly those encountered in a federal agency. - Troubleshoot data-related problems and provide innovative solutions to address complex data challenges. - Implement and enforce data governance policies and procedures, ensuring compliance with regulatory requirements and industry best practices. - Work closely with cross-functional teams to understand data requirements and design optimal data models and architectures. - Collaborate with data scientists, analysts, and stakeholders to provide timely and accurate data insights and support decision-making processes. - Maintain documentation for software applications, workflows, and processes. - Stay updated with emerging trends and advancements in data