[Hiring] Data Engineer @Blackbird.AI

Blackbird.AI helps organizations discover emergent threats and stay one step ahead of real-world harm through our AI-powered Narrative and Risk Intelligence Platform. Our commitment is to prioritize safety and security, providing the tools to identify potential risks and ensure a safer environment proactively. No matter the job or where it’s located, we’re all connected by a shared vision: To lead and enhance the landscape of risk intelligence.

Reporting to the Head of Data Engineering, the Data Engineer will optimize data pipelines for our cutting-edge real-time streaming cloud-hosted analytics platform. You will be the key driver of our collection, analysis, and visualization processes and will play a pivotal role in shaping the future of our platform.

The Data Engineer will encompass writing ETL processes, designing database systems, and developing tools for query and analytic processing, all focusing on real-time streaming applications. Additionally, you will elevate performance tradeoffs, own the database architecture, and lead build automation, continuous integration, and deployment efforts while ensuring adherence to security requirements.

As the Data Engineer, you’ll have the chance to:

• Write ETL processes to support the ingestion and normalization of various data formats from social media, news, and web sources.
• Design robust database systems and developing tools for query and analytic processing, especially for real-time streaming applications.
• Conduct performance analysis and empirical studies to evaluate tradeoffs (e.g., cost vs. throughput/latency).
• Develop, manage, and own the database architecture for our real-time streaming cloud-hosted analytics platform.
• Lead build automation, continuous integration, deployment, and performance optimization efforts while ensuring compliance with security requirements.
• Lead design of test suites and inline instrumentation as needed to ensure data correctness

Requirements

What you’ll bring:

• Bachelor’s degree in Computer Science or related field.
• Proven success in deploying products in the cloud and SaaS model, with expertise in building optimized processing pipelines for streaming analytics applications and cloud-agnostic solutions (e.g., Kubernetes, Docker).
• Expertise in databases and query optimization, including PostgresSQL, ElasticSearch, MongoDB, Redis, and Druid, with additional experience in NoSQL and graph databases being advantageous.
• Experience in horizontally scaling databases.
• Proficiency in Kafka and Airflow, with a deep understanding of runtime profiling tools to optimize throughput and latency, and able to establish comparative performance benchmarks.
• Strong skills in build automation, continuous integration, and deployment (CI/CD) tools like Webpack, Buddy, Jenkins, and Docker.
• Expert-level Python coding skills.
• Experience collaborating with distributed teams.

Helpful to have:

• Technical background in Artificial Intelligence (AI) and Machine Learning (ML).
• Experience designing and implementing interactive query-driven main-machine intelligence systems.
• Solid skills in Java.

We’ve outlined specific skills, experience, and requirements for this position, but don’t stress if you don’t meet every single one. Our Talent Team is dedicated to discovering exceptional individuals, and they might identify a relevant aspect of your background that suits this role or another opportunity within Blackbird.AI.

If you have passion for the role, please still apply.

What’s in it for you:

Blackbird.AI is embarking on an exciting growth journey with numerous opportunities for career development within the company. You will join a nurturing, inclusive, and experienced team.

Join us as we soar to new heights!

Values:

At Blackbird.AI, our core values shape how we work and make decisions. Our values inspire us to be authentic and continue improving.

We embrace a strong sense of responsibility to society, recognizing the vital role our services play in empowering governments, communities, and individuals to foster critical thinking and empowerment. We believe in integrating personal and professional lives with societal needs, emphasizing the importance of creating an environment that attracts top talent and provides substantial growth opportunities. We are motivated by the potential of science and technology to impact humanity positively.

Benefits

Why you’ll love working here:

• Competitive compensation package, 401(k), and equity – everyone has a stake in our growth!
• Comprehensive health benefits for you and your loved ones, including wellness days and monthly wellness reimbursements – an apple a day doesn’t always keep the doctor away!
• Generous vacation policy, encouraging you to take the time you need – we trust you to strike the right work/life balance!
• A flexible work environment with opportunities to collaborate with your team in person – you can have it all!
• Inclusion and Impact – soar to new heights!
• Bi-annual offsites – have fun with your colleagues!
• Professional development stipend – never stop learning!

Pay Transparency:

For individuals assigned and/or hired to work in New York, Blackbird.AI is required by law to include a reasonable estimate of the compensation range for this role. This compensation range is specific to New York. It takes into account the wide range of factors that are considered in making compensation decisions, including, but not limited to, skill sets, experience and training, licensure and certifications, and other business and organizational needs. At Blackbird.AI, it is not typical for an individual to be hired at or near the top of the range for their role, and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current compensation range for this position is expected to be $130,000-$170,000. This range may vary for positions outside of New York and as it has not been adjusted for the applicable geographic differential associated with the location where the position may be filled. 

Regardless of location, candidates can expect during the first few conversations with Blackbird.AI’s Talent Team and Hiring Managers to share any approved budget.

Apply Today

Equal Opportunity Employer