Kafka jobs in crypto and blockchain companies

Biconomy empowers Web3 developers to build seamless, user-friendly dApps that work effortlessly across multiple blockchains. Our battle-tested modular account and execution stack eliminates traditional UX friction points, helping projects accelerate user adoption while reducing development costs. By processing over 50 million transactions across the 300+ dApps we've served, we're powering the future of onchain economies.The Role: Innovating at the Intersection of AI and DeFiWe are assembling a world-class team to redefine on-chain analytics using AI Agents & Machine Learning. As a DevOps Engineer, you will build and optimize the AI & ML infrastructure, enabling real-time wallet activity analysis, ML-driven tagging, and PnL insights at scale. You’ll work with Kafka, Snowflake, AWS S3, and high-speed data pipelines to process over 10-15 billion rows of historical data and real-time streaming events, ensuring a scalable, secure, and efficient AI ecosystem.This is a high-impact role at the core of our AI-driven crypto intelligence platform.What Will You Be Doing?Scalable AI & ML InfrastructureDesign & optimize cloud-native architectures for AI & ML-driven analytics on DeFi transactions.Develop and maintain high-performance, distributed computing environments that process billions of on-chain and off-chain events.Deploy and manage ML models & AI agents efficiently in Kubernetes (K8s) and other containerized environments.High-Speed Data EngineeringDesign real-time streaming pipelines using Kafka for high-frequency on-chain transaction ingestion.Optimize Snowflake queries & storage solutions to handle large-scale blockchain datasets efficiently.Implement ETL/ELT pipelines for structured & unstructured blockchain data aggregation.Infrastructure Automation & ReliabilityAutomate cloud infrastructure using Terraform, Pulumi, or CloudFormation for seamless scaling.Enhance security & performance with CI/CD best practices for AI model deployment.Implement observability, logging & monitoring with tools like Prometheus, Grafana, and Datadog.ML & AI Model DeploymentStreamline model deployment for AI agents that analyze blockchain wallet behavior.Build infrastructure to support model training, inference, and real-time decision-making.Optimize GPU workloads for AI-driven pattern recognition & risk analysis.Collaboration Across TeamsWork alongside AI engineers, blockchain developers, and data scientists to integrate AI-driven insights into DeFi tools.Optimize node infrastructure & RPC services for multi-chain DeFi interactions.Research and implement best practices in Web3 DevOps, cloud automation, and ML infrastructure.Requirements:Core Experience5+ years of DevOps experience, specializing in AI/ML infrastructure & high-scale data pipelines.Expertise in AWS, GCP, or Azure, focusing on scalable, event-driven architectures.Experience handling Kafka queues, Snowflake databases, and massive-scale data processing.DevOps & Infrastructure SkillsCI/CD Automation using GitHub Actions, CircleCI, Jenkins, or ArgoCD.Kubernetes & Docker for managing AI workloads and high-performance model inference.Infrastructure-as-Code (IaC): Terraform, Pulumi, or CloudFormation.Data Engineering & AI Model OpsExperience with Kafka, Snowflake, and S3 for real-time & historical data processing.ML Model Deployment: Knowledge of TensorFlow, PyTorch, or ONNX for AI-based wallet analytics.Strong Python & Bash scripting for automation and orchestration.Security & ReliabilitySecurity-first mindset: Experience with IAM, firewall management, and Web3 security best practices.Observability & Monitoring using Prometheus, Grafana, Datadog, or OpenTelemetry.Bonus SkillsExperience with multi-chain blockchain infrastructure (Ethereum, Solana, L2s).Knowledge of DeFi protocols, smart contracts, and risk analytics.Experience with AI inference at scale (Ray, Triton, Hugging Face Transformers, etc.)What We Offer:Flexible Working Hours: Enjoy autonomy over your schedule.Generous Vacation Policy: 25 days vacation per year plus public holidaysCompetitive Salary: With regular performance reviews.Token Allocation: Be rewarded with tokens as part of our compensation package.Growth Opportunities: Be part of an exciting new project with significant career growth potential.Innovative Work Culture: Join a team that’s at the cutting edge of Web3, AI, and DeFi, and help shape the future of the digital economy.Fun and Engaging Team Activities: Game nights, virtual celebrations, and work retreats to keep things exciting.At Biconomy, we believe in creating a diverse and inclusive workplace. We are committed to being an equal-opportunity employer, and we do not discriminate based on race, national origin, gender, gender identity, sexual orientation, disability, veteran status, age, or any other legally protected status.

Echo Base is a private holding company pursuing special situation control investments in the digital assets space. Our global crypto team possesses deep experience in both the scaling of new ventures and the restructuring of complex assets with asymmetric risk profiles. Through lateral acquisitions, Echo Base seeks to leverage operational and technical synergies across our portfolio companies.The DevOps Principal Engineer is responsible for overseeing the strategy, architecture, and operations of Echo Base’s DevOps environment. This role requires deep expertise in cloud infrastructure, security protocols, and monitoring tools, alongside exceptional leadership skills to guide a high-performing team. The ideal candidate ensures reliability, scalability, and compliance for Echo Base’s cryptocurrency services while driving team collaboration and technical innovation.What will you do: Develop and execute a comprehensive DevOps strategy to ensure scalability, uptime, and security for Echo Base’s cryptocurrency platforms and services. Oversee the design, deployment, and optimization of AWS cloud infrastructure, ensuring high performance, cost efficiency, and alignment with cloud-native architectural best practices. Drive the adoption and implementation of observability tools like Splunk, Prometheus, and Grafana, enabling proactive monitoring, alerting, and rapid issue resolution. Build and manage automated workflows and event-driven systems using Apache Airflow and AWS Lambda to streamline operations and enhance system reliability. Implement robust data visualization and reporting solutions with Superset, delivering actionable insights for transaction metrics and operational KPIs. Conduct regular security audits, enforce compliance with cryptocurrency regulations, and implement data protection best practices to safeguard user and system integrity. Act as the primary escalation point for critical incidents, leading swift resolution efforts and driving improvements through comprehensive post-mortem reviews. Report key DevOps metrics, operational performance updates, and technical strategies to senior leadership, aligning team efforts with company goals. Who you are: Proven leader with expertise in cloud platforms, DevOps best practices, and AWS services. Skilled at fostering collaboration, mentoring team members, and resolving critical issues. Passionate about innovation and optimization in high-security, high-availability environments. What we are looking for: 7+ years of experience in DevOps, Cloud Engineering, or related fields, with 3+ years in leadership roles, demonstrating the ability to coordinate cross-functional teams, prioritize tasks, and manage escalations. Advanced expertise in AWS services, including EC2, S3, Elasticache, ECS, DynamoDB, Route 53, WAF, SNS, CloudWatch, and ELB, for designing and managing scalable, secure, and high-performance cloud architectures. Strong knowledge of DevOps best practices, including GitOps, CI/CD methodologies, and infrastructure-as-code tools such as Terraform and CloudFormation. Proficiency in workflow orchestration tools like Apache Airflow and event-driven architectures using Kafka and AWS Lambda. Expertise in monitoring and visualization tools, including Splunk, Prometheus, Grafana, and Apache Superset, to ensure comprehensive system visibility and actionable insights. In-depth knowledge of security protocols and tools, such as KMS, Certificate Manager, CloudTrail, and WAF, for safeguarding infrastructure and ensuring compliance. Familiarity with cryptocurrency-specific systems, including wallet security, transaction processing, and compliance standards, with an emphasis on adhering to global regulations. About the companyEcho Base is a private holding company formed for the purpose of pursuing special situation control investments in the digital assets space. Our global crypto team possesses deep experience in both the scaling of new ventures and the restructuring of complex assets with asymmetric risk profiles. Through lateral acquisitions, Echo Base seeks to leverage operational and technical synergies across our portfolio companies.

Our client leads the field in quantitative research and optimization of DeFi economics. They manage market risk, optimize growth, and ensure economic safety for protocols facilitating most spot trading, borrowing, and lending activity across all of DeFi, protecting and optimizing the largest protocols and networks in the industry. As of September 2024, they are currently managing risk and incentives covering over $46 billion in customer TVL.They continually publish cutting-edge research that informs risk models, alerts, and analysis, and is among the most cited institution — including academic institutions — in terms of peer-reviewed papers addressing DeFi as a subject. Their mission is to drive adoption and understanding in the financial systems of the future. Building with decentralized systems creates novel challenges for mechanism designers, smart contract developers, and end-users of financial products, which are not seen in traditional software development and investing contexts. They are dedicated to enhancing our industry’s understanding of this new domain, and revealing how to safely navigate the true bleeding edge of 21st century financial innovation.Key Responsibilities:Design, build, and maintain robust, scalable systems for data from DeFi protocols, blockchain networks, and various other data sourcesContribute to making our platform world-classCollaborate with stakeholders to understand their system requirements and provide the necessary support to help their productivity.Implement quality control measures to ensure system integrity and qualityActively participate in code and design reviews, providing constructive feedback to peers and maintaining high coding standardsKeep up-to-date with the latest industry trends, technologies, and best practices to ensure the continuous improvement of the platformContribute to the creation of technical documentation and user guidesTroubleshoot, diagnose, and resolve software defects, ensuring optimal system performance and reliabilityKey Requirements:At least 4 years of professional development experience. Experience developing production-quality software in high-performance languages. We currently use Python, Next.s & Typescript but are open.Experience with distributed data processing frameworks and related technologies such as Dagster, Prefect, Airflow, Kafka, Spark, Flink, etc.Experience with building backend systems.Demonstrated experience in optimizing front-end performance and familiarity with browser APIs.Ability to quickly internalize abstract concepts in new domains, coupled with strong problem-solving skills and attention to detail.Ability to work independently and within a team, manage multiple projects, and meet deadlines.Strong communication skills and the ability to work collaboratively in a distributed team environmentPassion for DeFi and the broader crypto ecosystem, with a willingness to immerse oneself in the space.Preferred Requirements:Experience working in the crypto industry is a big plus but not required.Experience with Hardhat & Postgres preferredEnthusiasm for the space, especially DeFi, is very much desired.Background in smart contract development (e.g., Solidity) or contributions to the DeFi community through research or open-source projects.Benefits and Perks:Remote first - work from anywhere in the US & CAN!Competitive packages with the added opportunity for incentive based compensationRegular in-person company retreats and cross-country "office visit" perk100% paid medical, dental and vision premiums for employeesLaptop, monitor, keyboard and mouse setup provided$1,000 WFH stipend upon joining$100 per month reimbursement for fitness-related expensesMonthly reimbursement for home internet, phone, and cellular dataUnlimited vacation policy100% paid parental leave of 12 weeksFertility benefits