Senior Data Engineer id-6227
Job Description
About the Team
The Data Platform and Solutions team builds and maintains the data platform that ingests data from various data sources, transforms that data and maintains the business logic, then pushes out that data to power our reporting, our AI/ML features, our critical customer-facing applications and APIs, and fuels our GTM systems to empower CircleCI to be the premier data-driven company in the CI/CD space.
About the Role
CircleCI is seeking an experienced Data Engineer to own and further develop our data infrastructure, ingestion, and to help us build our data products. This will include data ingestion/validation/alerting, AI/ML systems, and customer-facing APIs. As the initial data engineering hire, you'll work independently while collaborating closely with both engineering and other data teams to build robust, scalable data systems. We're seeking someone with a voracious appetite for solving complex problems and who can innovate and collaborate with teams across CircleCI.
Other Jobs You May Be Interested In
Remote Data Entry, No Experience, $40/hr, Part-Time
Virtual Assistant, $45/hr, Remote, No Experience, Night Job
Entry-Level Remote Data Entry, $50/hr, Evening Job
Customer Support, No Degree, $40/hr, Remote, Weekend Job
Remote Phone Job, $42/hr, Part-Time, College Student Friendly
Virtual Assistant, $40/hr, Remote, No Degree, Night Job
Part-Time Data Entry, $45/hr, Remote, College Student Friendly
Remote Moderator, No Degree, $50/hr, Evening, Weekend Job
Remote Customer Support, $42/hr, Night Job, No Experience
Live Chat Support, $40/hr, Remote, Entry Level, Part-Time
Virtual Assistant, Remote, $42/hr, Weekend, No Experience
Remote Data Entry, $45/hr, No Degree, Night Shift
Part-Time Customer Support, $40/hr, Remote, College Student
Remote Live Chat, $50/hr, Part-Time, Evening/Night Job
Entry Level Phone Job, $42/hr, Remote, No Degree Required
Weekend Data Entry, $45/hr, Remote, No Experience
Remote Virtual Assistant, $40/hr, Evening, Part-Time Job
Remote Moderator, $42/hr, Part-Time, Weekend, No Degree
Data Entry, $45/hr, Remote, Night Shift, College Student Job
Phone Support, Remote, $50/hr, No Experience, Part-Time
Virtual Assistant, No Experience, $42/hr, Remote, Weekend
Remote Customer Support, $45/hr, Part-Time, College Student
Data Entry, Remote, $40/hr, Night Shift, No Degree
Evening Virtual Assistant, Remote, $45/hr, No Experience
Weekend Customer Support, $42/hr, Remote, College Student
Remote Data Entry, $50/hr, No Experience, Evening/Night Job
Remote Live Chat, $40/hr, Part-Time, No Degree Required
Virtual Assistant, $42/hr, Remote, Weekend, Entry Level
Remote Phone Support, $45/hr, Evening, No Experience Required
Data Entry, No Experience, $50/hr, Remote, College Student
Remote Moderator, $40/hr, Weekend, No Degree, Part-Time
Live Chat Support, Remote, $42/hr, Night Shift, College Student
Phone Job, $50/hr, Remote, No Degree, Part-Time, Weekend
Data Entry, $45/hr, Remote, Evening, No Experience Required
Virtual Assistant, No Experience, $42/hr, Remote, Part-Time
Remote Customer Support, $50/hr, Night Shift, No Degree
Remote Data Entry, $40/hr, College Student Friendly, Part-Time
Live Chat Support, $42/hr, Weekend, Remote, No Degree
Virtual Assistant, Remote, $45/hr, Evening, No Experience
Remote Phone Job, $50/hr, College Student, Night Shift
Remote Moderator, $42/hr, Weekend, No Experience Required
Data Entry, No Degree, $45/hr, Part-Time, Remote Job
Customer Support, $50/hr, Remote, Evening/Night Job, No Degree
Virtual Assistant, $42/hr, Remote, Weekend, No Degree
Remote Live Chat, $45/hr, College Student, No Experience
Remote Data Entry, $40/hr, Part-Time, No Degree Required
Phone Support, $50/hr, Weekend, Remote, No Experience
Virtual Assistant, $42/hr, Evening, Remote, No Degree
Remote Customer Support, $45/hr, No Experience, Part-Time
Data Entry, $50/hr, Night Job, No Degree, Remote
Remote Moderator, $40/hr, College Student Friendly, Part-Time
Virtual Assistant, Remote, $42/hr, Weekend, No Experience
Remote Phone Job, $45/hr, Part-Time, No Degree Required
Customer Support, $50/hr, Night Job, Remote, No Experience
Data Entry, Remote, $42/hr, Evening Job, No Degree
Live Chat Support, $45/hr, Weekend, Remote, College Student
Virtual Assistant, Remote, $50/hr, Part-Time, Night Shift
Data Entry, $40/hr, No Experience, Remote, Weekend Job
Remote Phone Job, $45/hr, No Degree, College Student Friendly
Customer Support, $42/hr, Remote, Evening, No Experience
Virtual Assistant, $50/hr, Weekend, No Degree, Remote
Remote Data Entry, $40/hr, Part-Time, College Student Job
Phone Support, Remote, $42/hr, Evening/Night Shift
Virtual Assistant, No Degree, $45/hr, Remote, Part-Time
Live Chat Support, $50/hr, Remote, No Experience Required
Remote Moderator, $42/hr, College Student, Weekend Job
Data Entry, $45/hr, Remote, Night Job, No Degree
Virtual Assistant, $50/hr, Remote, Part-Time, Evening Job
Remote Customer Support, $42/hr, Weekend, No Experience
Phone Job, $45/hr, Remote, Night Shift, No Degree
Remote Live Chat, $50/hr, College Student, No Experience
Data Entry, $40/hr, Part-Time, Remote, Weekend Job
Virtual Assistant, $42/hr, Remote, No Experience, Evening
Remote Phone Support, $45/hr, Night Job, College Student
Remote Moderator, $50/hr, No Degree, Weekend, Part-Time
Virtual Assistant, $40/hr, Remote, Night Shift, No Experience
Customer Support, $42/hr, Remote, Part-Time, No Degree
Remote Data Entry, $45/hr, Weekend Job, College Student
Phone Support, Remote, $50/hr, No Experience, Night Shift
Virtual Assistant, $42/hr, Evening, Remote, College Student
Live Chat Support, $45/hr, Part-Time, Remote, No Degree
Data Entry, $50/hr, Remote, Evening Job, College Student
Virtual Assistant, $40/hr, Weekend, Remote, No Experience
Remote Phone Job, $42/hr, Night Shift, College Student Friendly
Remote Customer Support, $45/hr, No Degree, Evening Job
Virtual Assistant, $50/hr, Part-Time, Remote, Weekend Job
Data Entry, $40/hr, Evening Job, No Experience, Remote
Remote Live Chat, $42/hr, Weekend, No Degree, Part-Time
Virtual Assistant, $45/hr, No Experience, Remote, Night Job
Phone Job, $50/hr, Remote, Part-Time, College Student
Remote Data Entry, $42/hr, Evening/Night Job, No Experience
Remote Moderator, $45/hr, No Degree, Weekend Job, Part-Time
Live Chat Support, $50/hr, Remote, Night Shift, No Degree
Virtual Assistant, $40/hr, Weekend, College Student, Remote
Remote Phone Job, $42/hr, Part-Time, No Experience Required
Remote Data Entry, $45/hr, No Degree, Weekend, Night Job
Virtual Assistant, $50/hr, Evening, Remote, College Student
Customer Support, $42/hr, Weekend Job, Remote, No Degree
Phone Support, $45/hr, Remote, No Experience, Evening Job
Data Entry, $50/hr, Night Shift, No Degree, Remote Job
Key Responsibilities
- Design and implement data architectures that support efficient data flow across the organization
- Build and maintain event-based logging systems to ensure comprehensive data capture
- Establish and enforce data contracts to maintain data quality and consistency
- Optimize data infrastructure costs while maintaining performance
- Create and maintain data pipelines using modern orchestration tools
- Partner with analytics engineers to ensure data availability and reliability
- Evaluate and implement new data tools and technologies as needed
Required Qualifications
- 5+ years of experience in data engineering roles
- Strong expertise in Python and SQL
- Proven experience with modern data warehousing solutions, particularly Snowflake
- Deep understanding of database systems, including PostgreSQL
- Hands-on experience with data integration tools like Fivetran
- Knowledge of CI orchestration tools like CircleCI or dbtCloud
- Proficiency with data pipeline orchestration platforms like Apache Airflow
- Experience with modern data transformation tools, specifically dbt
- Track record of implementing event-based logging systems
- Strong background in data modeling and architecture design
Required Skills
- Self-motivated with ability to work independently
- Excellent problem-solving and analytical skills
- Strong communication abilities to work effectively with both technical and non-technical stakeholders
- Experience in implementing and maintaining data quality standards
- Proven ability to optimize data infrastructure costs
- Experience with data contract design and implementation
Preferred Qualifications
- Experience being a founding member of a data engineering team
- Background in data security and compliance
- Experience with batch and microbatch data processing systems
- Knowledge of data observability tools and practices
- Experience with GPU infrastructure management and optimization
- Familiarity with ML model versioning and experiment tracking tools
Canada Base Pay Range
$133,000-$166,000 CAD
We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.
About CircleCI
CircleCI is the world's largest continuous integration/continuous delivery (CI/CD) platform, and the hub where code moves from idea to delivery. As one of the most-used DevOps tools - processing more than 3 million jobs a day - CircleCI has unique access to data on how the most effective engineering teams work, and the tools to help software companies successfully leverage the power of AI into their commercial applications. Companies like Hinge, HuggingFace, and Samsung use us to improve engineering team productivity, release better products, and get to market faster.
Founded in 2011 and headquartered in downtown San Francisco with a global, remote workforce, CircleCI is venture-backed by Base10, Greenspring Associates, Eleven Prime, IVP, Sapphire Ventures, Top Tier Capital Partners, Baseline Ventures, Threshold
Ventures, Scale Venture Partners, Owl Rock Capital, Next Equity Partners, Heavybit, and Harrison Metal Capital.
CircleCI is an Equal Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law.
