Bitsight Technologies Logo

Bitsight Technologies

Sr. Data Engineer

Posted 17 Days Ago
Be an Early Applicant
2 Locations
140K-160K Annually
Senior level
2 Locations
140K-160K Annually
Senior level
The Senior Data Engineer will optimize data flows, ensure data quality, manage data pipelines, and collaborate with teams to enhance data strategies.
The summary above was generated by AI

Bitsight is a cyber risk management leader transforming how companies manage exposure, performance, and risk for themselves and their third parties. Companies rely on Bitsight to prioritize their cybersecurity investments, build greater trust within their ecosystem, and reduce their chances of financial loss.
Built on over a decade of technological innovation, its integrated solutions deliver value across enterprise security performance, digital supply chains, cyber insurance, and data analysis.

  • We invented the cyber ratings industry in 2011
  • Over 3000 customers trust Bitsight
  • Over 750 teammates are dispersed throughout Boston, Raleigh, New York, Lisbon, Singapore, and remote

 We are looking for a seasoned and talented Senior Data Engineer, who is well-versed in collaborating with cross-functional teams to address various data engineering challenges for the data science team and drive business impacts. 

 Responsibilities:

  • Optimize data flows and collection, thereby improving the efficiency, capacity and reliability of our data operations

  • Implement processes and systems to monitor data quality, ensuring production data is always accurate and available

  • Bringing innovation in the scalable data pipeline and infrastructure development and maintenance

  • Add new sources, code business rules, and produce new metrics that support data science and security research

  • Create and implement code, along with unit/integration tests, and applies coding patterns, guidelines, styles, and best practices; and adheres to all other requirements

  • Contribute to data science and engineering internal documents and roadmap development

  • Work closely with all business units and engineering teams to develop a strategy for long-term data architecture

  • Independently and consistently delivering high-quality data engineering support to the data scientists and security researchers.

Requirements:

  • More than 5 years of experience as a Software/Data Engineer, with significant experience working on SaaS products.

  • Strong academic background in quantitative field (Computer Science, Engineering or Applied Mathematics)

  • Proficient in managing and developing scalable data pipelines and automation of data workflows using Python & Spark / Scala.

  • In-depth knowledge of AWS infrastructure and technology stacks for handling large datasets and table formats in a data lake environment.

  • Experience in data models, data warehousing, building and optimizing ETL pipelines

  • Deep understanding and experience of orchestration tools, CI/CD paradigms, and SDLC best practices.

  • Proven experience with SQL/NoSQL data warehouses.

  • Skilled at optimizing large datasets and developing operational processes that improve data quality.

  • Familiarity with container technologies such as Docker and Kubernetes.

  • Experience in managing and communicating data warehouse plans.

  • Ability to clearly present findings to business leaders and technical stakeholders

Preferred:

  • Previous Experience in working closely with data scientists and cross-functional teams, supporting and driving innovation and research initiatives

  • An understanding of agile methodologies and an ability to adapt in a fast-paced, dynamic environment.

  • Experience in transforming complex, large-scale datasets into actionable insights.

  • Exposure to Machine Learning Operations (MLOps) strategies and architectures.

  • Forward-thinking mentality, not afraid to venture into uncharted territories and eagerly taking on any other tasks that might arise.  

Diversity. Bitsight is proud to be an equal opportunity employer. This means we do not tolerate discrimination of any kind and are committed to providing equal employment opportunities regardless of your gender identity, race, nationality, religion, sexual orientation, status as a protected veteran, or status as an individual with a disability.

Culture. We put our people first. Bitsight offers best in class benefits. We devote the same energy to nurturing our company's inclusive culture as we apply to serving our customers' needs. Working at Bitsight will give you the opportunity to fulfill your professional goals and expand your skills.

Open-minded. If you got to this point, we hope you’re feeling excited about the job description you just read.  Even if you don’t feel that you meet every single requirement, we still encourage you to apply.  We’re eager to meet people that believe in Bitsight’s mission and can contribute to our team in a variety of ways.

Additional Information for United States of America Applicants:

Bitsight also provides reasonable accommodations to qualified individuals with disabilities or based on a sincerely held religious belief in accordance with applicable laws. If you need to inquire about a reasonable accommodation, or need assistance with completing the application process, please email [email protected]. This contact information is for accommodation requests only, and cannot be used to inquire about the status of applications.

Qualified applicants with criminal histories will be considered for employment consistent with applicable law.

This position may be considered a promotional opportunity pursuant to the Colorado Equal Pay for Equal Work Act.

The anticipated hiring base salary range for this position is US$140,000 to $160,000 annually for US-based employees.  This range reflects the minimum and maximum target for new hire salaries for the position across all US locations, is based on a full-time work schedule, and is Bitsight’s good faith estimate as of the date of this posting.  Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training.In addition to base salary, this role is eligible for participation in a bonus or commission plan and an equity grant.  Bitsight also offers a competitive benefits package, including but not but limited to medical, dental, and vision insurance; paid parental leave; flexible time off; a 401(k) plan with employee and company contribution opportunities; life and disability insurance; and tuition reimbursement.

Top Skills

AWS
Docker
Kubernetes
NoSQL
Python
Scala
Spark
SQL
HQ

Bitsight Technologies Boston, Massachusetts, USA Office

111 Huntington Ave, Boston, MA, United States, 02199

Similar Jobs

Yesterday
Hybrid
Boston, MA, USA
176K-216K Annually
Senior level
176K-216K Annually
Senior level
Healthtech • Software • Analytics • Biotech • Pharmaceutical • Manufacturing
The Senior Data Engineer will design robust solutions for data ingestion and transformation, manage data pipelines, optimize models with AI/ML, and participate in data integration projects.
Top Skills: DatabricksDenodoEltETLKafkaSage MakerSparkTeradata
5 Days Ago
Hybrid
Boston, MA, USA
100K-130K
Senior level
100K-130K
Senior level
eCommerce • Healthtech • Pet • Retail • Pharmaceutical
The Data Engineer II will design, develop, and maintain data pipelines, tackle complex data issues, and enhance analytics efficiency, partnering with various teams and mentoring peers.
Top Skills: AthenaAWSConfluenceDatabricksDockerDremioGlueJavaKafkaPrestoPysparkPythonRedshiftScalaSnowflakeSparkSQL
13 Days Ago
Hybrid
2 Locations
150K-170K Annually
Senior level
150K-170K Annually
Senior level
AdTech • Big Data • Digital Media • Software
The role involves architecting and building systems to handle large-scale data, oversee data pipelines, and ensure data consistency while fostering a culture of collaboration and mentorship.
Top Skills: AirflowAWSDatabricksDockerEc2EcsJavaJenkinsKinesisRdsS3ScalaSparkTerraform

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account