OptIQ is revolutionizing the data security landscape by building the world's first AI-Data Security Engineer. Our platform empowers organizations to classify sensitive data, identify risky data movements, detect misuse, and create security policies using natural language. With an AI-powered Threat Detection Engine, OptIQ analyzes events from cloud and endpoint logs to uncover dynamic risks such as data exfiltration and breaches. By providing comprehensive visibility into the data landscape, assessing risks, and enforcing robust security policies, OptIQ ensures compliance with data protection regulations across cloud and SaaS environments.
We’re a fast-growing, high-potential startup redefining data security, and we’re looking for a Software Architect to join us on this exciting journey. This is an incredible opportunity to lead a talented engineering team and shape the foundational architecture of a revolutionary product.
About the Role:
As a Senior Data Engineer at OptIQ, you will:
- Design, build, and optimize scalable data pipelines to process petabyte-scale datasets efficiently.
- Develop and maintain ETL pipelines for structured and unstructured data from multiple cloud and on-prem sources.
- Architect, implement, and manage Big Data frameworks such as Apache Spark, Hadoop, and other distributed systems.
- Set up end-to-end ML data pipelines, enabling seamless model training and inference.
- Collaborate with Data Scientists, DevOps, and Security teams to develop robust data pipelines that power AI-driven security solutions.
- Optimize query performance and data storage strategies for efficient retrieval and processing of massive datasets.
- Lead best practices for data engineering, automation, and CI/CD integration to streamline data workflows.
This role offers the chance to work on cutting-edge technologies, drive impactful solutions, and be a pivotal part of a company that is transforming the data security market.
What You’ll Bring
Experience:
1-5 years in Data Engineering Role.
Technical Expertise:
- Big Data & Distributed Systems: Strong experience with Apache Spark, Hadoop, Kafka, and Flink.
- ETL Pipelines: Expertise in building and maintaining ETL workflows to process structured and unstructured data.
- ML Pipelines: Experience in developing data pipelines to support machine learning models, including feature engineering and model inference.
- Data Pipeline Architecture: Proven track record of setting up scalable data pipelines from scratch and handling petabyte-scale data loads.
- Cloud Data Platforms: Strong knowledge of AWS (Glue, Redshift, EMR), Azure (Data Lake, Synapse), or GCP (BigQuery, Dataflow).
- Data Storage & Optimization: Experience with columnar storage formats (Parquet, ORC), data partitioning, and indexing strategies.
- Programming: Proficiency in Python for data processing and scripting.CI/CD & DevOps: Familiarity with Terraform, CloudFormation, Docker, Kubernetes, and CI/CD pipelines for data workflows.
- Monitoring & Logging: Experience with Prometheus, Grafana, ELK stack, or similar tools for monitoring data pipeline health.
Mindset:
- Entrepreneurial spirit with a "get-things-done" attitude and a commitment to delivering high-quality solutions.
- Comfort working in an unstructured, fast-paced startup environment.
- Passion for solving complex problems and driving innovation in a high-growth company.
Education: B.Tech in Computer Science or equivalent.
Why Join OptIQ?
At OptIQ, you’ll have the unique opportunity to:
- Be a founding data engineer at an early-stage startup, shaping the future of our product and company.
- Own projects end-to-end and see the tangible impact of your work.
- Work in a collaborative, innovative environment with A players who are passionate about solving complex challenges.
- Grow rapidly with the company, developing both technical and leadership skills.
Perks and Benefits:
- Competitive compensation, including:
- Relocation Bonus
- Joining Bonus
- Retention Bonus
- Comprehensive healthcare coverage.
- Flexible work schedule with remote work options.
- Monthly internet reimbursement.
- Weekly team parties and monthly outings to celebrate successes.
- A modern, well-equipped office with free meals and snacks.
- Experience building a revolutionary product alongside a team of talented engineers.
