Big Data Software Engineer
GIGATEC Engineering
Annapolis Junction, MD4 months ago
94 views21 saves0 applies
Prepare for this role
Benefits
Health Insurance401kRetirement Plan
Job Type
full time
Description
Perks and Benefits
- 100% Paid Healthcare
- 10% 401k in every paycheck
- 100% Fully Vested!
NOTE – Our positions require a Top Secret clearance, as well as the favorable completion of a polygraph. Applicants must be authorized to work in the U.S. We are unable to sponsor an employment Visa.
What You’ll Be Doing (We don’t love the bullet points, but we love the work!)
Requirements
Required Skills and Experience (SWE Swiss Army knife with a keyboard)
• Using the Linux CLI and Linux tools• Developing Bash scripts to automate manual processes
• Recent software development experience using Python and Java
• Familiar with Streamlit, a Python framework for building interactive web applications
• Experience developing front-end applications using TypeScript, HTML, and CSS
• Experience with JavaScript frameworks such as React, Angular, and Vue
• Familiar with Distributed Big Data processing engines including Apache Spark
• Experience using Jupyter Notebook
• Experience with data wrangling and preprocessing using tools such as pandas, NumPy
• Experience working with structured, semi-structured, and unstructured data such as Parquet, JSON, CSV, XML
• Familiarity with data quality concepts, data validation, and anomaly detection
• Experience with Git Source Control System
Position Desired Skills
• Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows
• Experience with SQL technologies such as MySQL, MariaDB, and PostgreSQL for querying, joining, and aggregating large datasets
• Familiar with HPC Job Scheduling tools including Slurm
• Experience using the Atlassian Tool Suite (JIRA, Confluence)
• Appreciates a sense of humor and the occasional well-timed joke.
This job is found at InterviewStack.io
Skills
linuxbashpythonjavatypescripthtmlcssjavascriptreactangularvueapachesparkpandasnumpyparquetgitairflowsqlmysqlpostgresqljiradata quality
About GIGATEC Engineering
GIGATEC is an engineering firm focused on delivering advanced solutions for mission-critical challenges. We specialize in High Performance Computing and Infrastructure Engineering, Cybersecurity, and Advanced Data Analytics for the U.S. Department of Defense (DoD) and the Intelligence Community (IC).
it services and it consulting, cybersecurityWebsite