As a Data Engineer for Edstem Technologies, you will play a critical role in the development of data processing pipelines and systems designed to optimize AI workloads on NVIDIA GPUs. You’ll collaborate with talented system engineers to fine-tune performance and ensure efficient execution of AI jobs on cutting-edge hardware. Your primary responsibility will be to compare performance outcomes between NVIDIA GPUs and other AI infrastructure like Cerebras, tailoring solutions to meet client-specific project requirements.

Experience. 5+ years

Key Responsibilities

1. Support Data Processing and Pipeline Development. Build and optimize data pipelines for processing AI workloads using NVIDIA GPUs. Work with large datasets and implement high-throughput processing techniques to accelerate AI and machine learning applications.
2. Collaboration with System Engineers. Work closely with system engineers to design and implement GPU-accelerated data pipelines that maximize performance across the infrastructure.
3. Performance Comparison. Execute in-depth performance analysis and benchmarking between NVIDIA GPUs and other AI systems such as Cerebras, providing valuable insights for client projects.
4. AI Job Execution. Ensure efficient execution of AI jobs on NVIDIA infrastructure, optimizing resource usage and computational efficiency to meet client specifications.

Required Technical Skills

1. NVIDIA GPU Ecosystem. Strong understanding and hands-on experience with NVIDIA libraries such as CUDA, cuDNN, NCCL, and TensorRT for developing and optimizing GPU-accelerated applications.
2. Machine Learning Pipelines. Experience in building, deploying, and maintaining data pipelines tailored to AI workloads, specifically on GPU-based infrastructure. You will use modern tools like Dask, Apache Flink, and Pandas to manage and preprocess data.
3. Programming Expertise. Proficiency in Python and C++ for developing efficient, scalable data pipelines. Experience with Go is a plus. Knowledge of parallel programming techniques is essential to leverage the power of NVIDIA GPUs.
4. Cloud Platforms. Familiarity with AWS, GCP, or Azure cloud environments, especially in deploying, managing, and scaling GPU-based workloads. Experience in integrating NVIDIA GPUs into cloud platforms is highly desirable.
5. NVIDIA AI Tools and Frameworks. Proficiency in using NVIDIA’s suite of AI tools and frameworks, including TensorRT for optimizing deep learning models, cuDNN for efficient deep learning operations, and NCCL for communication between GPUs.

Preferred Qualifications

1. Educational Background. A degree in Data Engineering, Computer Science, or a related field. Alternatively, a comparable level of practical experience in a similar role.
2. Experience with Data Processing for AI Models. Proven experience working with AI models and data processing pipelines, specifically in GPU-intensive environments.
3. Familiarity with AI and GPU Infrastructure. A strong background in working with NVIDIA’s ecosystem and GPU infrastructure for AI workloads is preferred.

Why Edstem Technologies and Uplers?

At Edstem Technologies, you’ll be part of an innovative team that pushes the boundaries of AI and machine learning, leveraging the best-in-class GPU hardware. This role offers a unique opportunity to work on state-of-the-art technology, collaborating with professionals at the forefront of AI research and development.

Uplers is dedicated to providing seamless, hassle-free hiring and career progression for talented professionals like you. With this position, you will also have access to personalized support throughout your contract, including a dedicated Talent Success Coach to assist you with any challenges during your engagement.

How to Apply

• Register or login on the Uplers portal and fill out the application form.
• Clear the 30-minute Video Screening to move forward in the selection process.
• Once shortlisted, your profile will be shared with Edstem Technologies for the Interview round.
• If selected, you’ll meet with the client and embark on this exciting career journey!

Additional Information

• Contract duration, 6 months (with the possibility of extension based on performance).
• Flexible work hours based on client requirements, with remote work opportunities.
• Exposure to cutting-edge technology and challenging AI projects.

Join Us Today

This is your chance to work on groundbreaking AI projects with a dynamic team, utilizing the latest in NVIDIA GPU technology. If you are passionate about AI, data engineering, and GPU infrastructure, don’t hesitate to apply today!