Linux Engineer for AWS EC2 HPC Setup (SLURM + MPI)

@gunslinger

Hello, thanks for the invitation for me to bid on this project. yes, I can help you to setup AWS ec2 and installing required application and configure the server. please kindly contact me for further discussion Thank you Yuda

@LiveExperts

Hello, "With years of experience across a range of engineering and development fields and in-depth knowledge of Linux, AWS, Python and particularly Ubuntu, I am confident that my team at Live Experts is the perfect fit to meet your demand for creating a scientific computational environment on AWS. We have demonstrable expertise in setting up SLURM - including careful selection of the most appropriate EC2 instance type for CPU workloads - and configuring MPI-based software; while setting up databases like PostgreSQL is right within our routine. Our approach to working on projects similar to yours is based on solid comprehension of all technical aspects involved and harnessing the tools at our disposal to deliver high performance results. What sets us apart from others is not just our proficiency in solving complex engineering problems using cutting-edge technologies, but also our focus on understanding every client's unique needs and delivering tailor-made solutions that ultimately translate into increased efficiency and productivity. Furthermore, as avid advocates for results with superior functionality, we place great emphasis on thorough testing and benchmarking to ensure the performance of parallel jobs in an optimized manner. Choosing Live Experts would be choosing unparalleled dedication towards bringing your ideas to life while providing customer satisfaction at every stage. Get in touch today and let's discuss how we can best tackle your project!" Thanks!

@tangramua

Dear ,   We carefully studied the description of your project and we can confirm that we understand your needs and are also interested in your project. Our team has the necessary resources to start your project as soon as possible and complete it in a very short time.   We are 25 years in this business and our technical specialists have strong experience in Python, Linux, Cloud Computing, Amazon Web Services, PostgreSQL, Ubuntu, Simulation, Quantum Computing, System Administration, Materials Science and other technologies relevant to your project.   Please, review our profile https://www.freelancer.com/u/tangramua where you can find detailed information about our company, our portfolio, and the client's recent reviews.   Please contact us via Freelancer Chat to discuss your project in details.    Best regards, Sales department Tangram Canada Inc.     

@leadconcept

Greetings, We understand you need a Linux engineer to provision a high-performance scientific computing environment on AWS EC2, including CPU-optimized instance selection, SLURM setup, MPI software installation, PostgreSQL, message broker, Python virtual environment, and high-speed scratch storage, with verification of parallel job execution. Before proceeding, we would like to clarify: 1, Are there preferred MPI implementations or compilers you require (e.g., OpenMPI, Intel MPI) 2, Which message broker do you intend to use (RabbitMQ, Kafka, Redis) 3, Are there any specific storage performance targets or IOPS requirements for the scratch space Our team has experience deploying HPC and parallel computing environments on AWS, including multi-core EC2 clusters with SLURM, MPI workloads, PostgreSQL-backed job tracking, Python venv management, and high-throughput scratch storage using EBS or NVMe local volumes. We configure SLURM queues, optimize MPI performance, ensure secure and reproducible virtual environments, and validate parallel workloads across cores or nodes. We can discuss the full technical specification and prepare a detailed implementation plan. The current bid amount is a placeholder to start the conversation. Regards Yasir LEADconcept PS: Let me know, if you want to see our team past work to determine our skills/expertise or past customer's references.

@kuldeepvk

Hi, I will set up, manage and potentially troubleshooting your AWS service to ensure seamless data backup. I have 10 years of expertise in amazon web services. I can set up aws ec2, aws s3 and other amazon products with the best configuration, S3 bucket creation, mounting bucket to different EC2 instances, uploading contents into bucket, Expanding volume in live ec2 instance without data loss, DNS fail over and recovering it from same or different region , Backup of instances, database, volumes, Auto scalingin in which if any of the instance will stop responding then a copy of instance will be loaded so that there will be no down time, Monitoring services, Cloud front, it help us to load contents of website from near by location, Amazon Relational Database Services. Please discuss, Thank you.

@AZTURK1

Hi there, I will design and deploy a production-ready AWS EC2 HPC environment (SLURM + MPI + PostgreSQL + broker) tailored for CPU‑intensive scientific workloads , confident I can deliver a secure, high-performance cluster on Ubuntu. - Select and launch optimal EC2 instance type (CPU, network, EBS/instance storage) for your workload - Install and configure SLURM (controller + compute nodes), MPI stack and verify parallel jobs - Install PostgreSQL, a message broker (RabbitMQ/Redis), Python venv, and MPI-based software - Configure high-performance scratch (instance store or NVMe, tuned I/O) and job verification Skills: ✅ Linux ✅ Amazon Web Services ✅ MPI ✅ Docker/VM provisioning & deployment automation ✅ PostgreSQL / message broker setup & performance tuning ✅ Python virtualenv, system administration Certificates: ✅ Microsoft® Certified: MCSA | MCSE | MCT ✅ cPanel® & WHM Certified CWSA-2 I can start immediately and deliver a tested setup with documentation. How many total nodes (or vCPUs) and what is the typical per-job runtime and I/O profile so I can size instance types and scratch storage appropriately? Best regards,

@rupa37

With over 15 years of experience as a Linux Engineer with proven efficiency in AWS architecture and cloud computing, I am confident in my ability to deliver on your Linux engineering project. My familiarity with Ubuntu, in particular, will be instrumental in bringing to life your scientific computing environment on AWS EC2. In previous projects similar to yours, I have successfully handled the entire process from selecting the most appropriate AWS EC2 instance type for CPU-intensive workloads to ensuring parallel jobs run smoothly and accurately. These projects have often involved setting up PostgreSQL, creating Python virtual environments, and configuring high-performance scratch storage - jobs crucial to optimizing the performance of a scientific system like yours. Additionally, my expertise extends beyond just Linux engineering - I understand the importance of network security and efficient system management. This extends to my knowledge of HPE equipment which can be a great asset in handling your devices effectively. With me, this isn't just a job - it's an opportunity for me to use my accumulated skills across FreeBSD, Linux, DevOps tools, and more to provide you with the quality work you seek.

@SammyOpiyo

What about configure the applications to run on docker and use orchestration tools such as EKS, Rancher or ECS utilizing Autoscaling groups to run the application. Let us move from manual management of Instances and focus on application development/management. This will also ensure auto-scaling, auto-healing is supported. Let me know if you want to discuss more about the project with me so that I give specific recommendations. Samwel

@enervell

Hi, I am excited about the opportunity to assist with your scientific computing environment setup on AWS EC2. I have extensive experience in creating high-performance computing setups, involving AWS configurations tailored for CPU-intensive workloads. 1. **AWS EC2 Expertise**: I've helped multiple clients select the right EC2 instance types for their specific workload requirements, ensuring optimal performance. 2. **SLURM and MPI Installation**: I have successfully installed and configured SLURM and MPI-based software in similar environments, facilitating efficient job scheduling and management. 3. **PostgreSQL and Python Setup**: My experience includes setting up PostgreSQL and creating Python virtual environments to streamline development. 4. **High-Performance Storage**: Configuring high-performance scratch storage is a key part of my expertise, ensuring rapid data access for parallel jobs. I'm confident that we can get your environment running smoothly. I look forward to discussing the full technical details and how I can assist further.

@nickdevops

Hello my name is Nikos and Im working on the Linux server administration field for the past 12 years. Over these years I worked for two web hosting companies as a Senior Administrator managing their servers & providing customer support. I have extensive experience with the following control panels: CPanel, Plesk, Directadmin, SolusVM, VestaCP and many more. I can do what you are asking for. Message me for more details. Regards

@android2014213

Hi, I can help you to install configure SLURM and MPI based software and others mentioned in project description. Is this required to be configure in clustered environment ? if yes how many nodes are there? Thanks Ashish A.

@linuxpro2008

Worked with all kind of servers and all panels since 2007 And currently working as linux system administrator If you need to start as soon as possible contact me And tell me more details about what you want to Tell the time and cost accurately, please contact me now, looking forward to work with you Best regards

@Feriver

Hello, I understand you require an AWS EC2-based HPC environment optimized for CPU-intensive scientific computing. I can design and deploy a scalable setup including SLURM for job scheduling, MPI-based software, PostgreSQL, a message broker, and high-performance scratch storage, ensuring full parallel execution verification. My approach includes selecting the optimal EC2 instance types for workload, automated environment setup with Python virtual environments, storage tuning, and robust configuration of SLURM and MPI clusters. I will also ensure proper integration of PostgreSQL and messaging services for HPC workflows, along with documentation for reproducibility. Deliverables include a fully configured EC2 HPC instance, validated SLURM + MPI cluster, Python environment, PostgreSQL and broker setup, scratch storage configuration, and test scripts confirming parallel job execution, ready for production use. Clarification Questions: Should the HPC environment support dynamic scaling of nodes, or a fixed cluster size? Are there specific MPI applications or Python libraries that must be pre-installed for testing? Thanks, Asif.

@abhisaini0188

Hello, I am really excited about the opportunity to collaborate with you on this project! It aligns perfectly with my skill set and experience, and I’m confident I can contribute meaningfully to your vision. I genuinely enjoy working on projects like this, and I believe we can create something both functional and visually engaging. Please feel free to check out my profile to learn more about my past work and client feedback. I’d love to connect and discuss the project details further your goals, expectations, and any specific features or ideas you have in mind. The more I understand your vision, the better I can bring it to life. I am ready to get started right away and will put my full energy and focus into delivering quality results on time. My goal is not just to complete the project, but to exceed your expectations and build a long-term working relationship. Looking forward to hearing from you soon! With regards! Abhi

@nolk

Hi there, I have 10+ years of Unix/Linux administration and 5+ years experience as Cloud Architect, worked a lot with AWS offerings and will be happy to help you with your setup.

@Julian29

Hello, HAVE HANDS-ON EXPERIENCE WITH SUCH PROJECT With 15+ years of proven experience in Linux systems engineering and cloud-based scientific computing environments, I confidently understand your requirement to design and deploy a scalable, high-performance AWS EC2 setup optimized for CPU-intensive parallel workloads. The goal is to deliver a stable, reproducible compute environment with SLURM scheduling, MPI execution, and optimized storage for efficient job processing. -->> EC2 instance selection & performance benchmarking -->> SLURM cluster setup & configuration -->> MPI stack installation & validation -->> PostgreSQL & message broker deployment -->> Python virtual environments -->> High-performance scratch storage tuning I’ve previously deployed HPC-style environments on AWS using compute-optimized instances (C-series), configured SLURM with multi-node scaling, installed OpenMPI/MPICH stacks, and validated distributed workloads under heavy CPU utilization. I’ve also implemented NVMe-backed scratch volumes and optimized I/O performance for parallel jobs. My approach emphasizes clean infrastructure design (IaC-ready), secure configuration, performance tuning, and thorough validation to ensure reproducibility and scalability. Happy to discuss workload characteristics, expected node count, and storage requirements to recommend the optimal architecture. Thanks & regards Julian

@kumarashish99

As your Linux Engineer, I can bring over 5 years of in-depth backend development and DevOps engineering to your project. My AWS certification and extensive experience working on high-performance cloud infrastructures make me a perfect fit for your scientific computing environment setup. Moreover, my expertise in selecting optimal EC2 instance types for CPU-intensive workloads in Kubernetes platforms like AWS EKS demonstrates my ability to create highly-efficient environments for parallel processing tasks. In similar projects, I have successfully launched EC2 instances, configured SLURM and MPI-based software, and set up databases like PostgreSQL and message brokers. Integration between the various components and ensuring successful execution of parallel jobs are areas I am comfortable with as well. Drawing from my security-focused mindset and past experiences complying with stringent frameworks like HIPAA, PCI-DSS, GDPR, and ISO, I can also contribute to securing your infrastructure while creating a scalable solution that meets your unique requirements. Let's kickstart this project for transformative scientific computing on AWS EC2!

@usamae

Yes, I can handle this setup. I have done AWS EC2 provisioning for compute-intensive workloads before - selecting the right instance type matters a lot here (c6i or hpc6a family for CPU-bound MPI jobs, or m6i if you need memory headroom too). For SLURM I would set up a single-node or small cluster config depending on how many workers you need, configure the partition and queue settings, and test with a few sample parallel jobs before sign-off. MPI (OpenMPI or MPICH - your call) gets installed and linked against the Python environment so your scripts can call mpi4py or run MPI binaries directly. PostgreSQL and message broker (guessing RabbitMQ or Redis based on the context) go on the same instance or a separate t3 depending on load. Scratch storage I would set up as an EBS gp3 volume mounted at /scratch with the instance optimized for throughput. I can start immediately and share progress as I go. What is the MPI-based software you are installing - is it something like LAMMPS, Quantum ESPRESSO, or a custom Python MPI app? - Usama

@sahilcomputers39

Hi, With 16+ years of experience in Linux and AWS infrastructure, I can design and deploy a reliable HPC environment on AWS EC2 for your CPU-intensive scientific workloads. I will help select the most suitable EC2 instance type (compute-optimized or HPC class), configure secure networking, and optimize storage for high-performance scratch space. The setup will include SLURM installation and configuration, MPI (OpenMPI/MPICH) deployment, and validation of multi-node parallel job execution. I will also install and tune PostgreSQL and the required message broker, create a structured Python virtual environment, and ensure proper system-level performance tuning for CPU, memory, and I/O. Final validation will include SLURM queue testing, MPI communication checks, and benchmarking to confirm stable parallel processing. I have previously deployed AWS-based compute clusters for distributed processing and simulation workloads. We can finalize the budget after discussing workload scale and cluster size. Best regards, SaD