Poolside
Poolside is an accelerator specifically designed for web3 founders and builders. It provides support for projects in decentralized finance, gaming, governance, infrastructure, and NFTs. With a robust ecosystem of 20,000 members, including mentors, investors, and web3 builders, Poolside has co-launched and supported over 110 projects. The accelerator offers unique access to mentorship and technical expertise to help web3 projects scale and achieve successful launches. Poolside also engages with leading companies and protocols to drive growth and innovation in the web3 space.
Blockchain • Accelerator • Incubator • Hub • Fundraising
Member of Engineering - Pre-training
October 31, 2024
Poolside
Poolside is an accelerator specifically designed for web3 founders and builders. It provides support for projects in decentralized finance, gaming, governance, infrastructure, and NFTs. With a robust ecosystem of 20,000 members, including mentors, investors, and web3 builders, Poolside has co-launched and supported over 110 projects. The accelerator offers unique access to mentorship and technical expertise to help web3 projects scale and achieve successful launches. Poolside also engages with leading companies and protocols to drive growth and innovation in the web3 space.
Blockchain • Accelerator • Incubator • Hub • Fundraising
📋 Description
• You would be working on our pre-training team focused on building out our distributed training of Large Language Models and major architecture changes. • This is a hands-on role where you'll be both programming and implementing LLM architectures (dense & sparse) and distributed training code all the way from data to tensor parallelism, while researching potential optimizations (from basic operations to communication) and new architectures & distributed training strategies. • You will have access to thousands of GPUs in this team. • To train the best foundational models for source code generation in the world in minimum time and with maximum hardware utilization.
🎯 Requirements
• Experience with Large Language Models (LLM) • Deep knowledge of Transformers is a must • Knowledge/Experience with cutting-edge training tricks • Knowledge/Experience of distributed training • Trained LLMs from scratch • Coded LLMs from scratch • Knowledge of deep learning fundamentals • Strong machine learning and engineering background • Research experience • Author of scientific papers on any of the topics: applied deep learning, LLMs, source code generation, etc. - is a nice to have • Can freely discuss the latest papers and descend to fine details • Is reasonably opinionated • Programming experience • Linux • Strong algorithmic skills • Python with PyTorch or Jax • C/C++, CUDA, Triton • Use modern tools and are always looking to improve • Strong critical thinking and ability to question code quality policies when applicable • Prior experience in non-ML programming, especially not in Python - is a nice to have
🏖️ Benefits
• Fully remote work & flexible hours • 37 days/year of vacation & holidays • Health insurance allowance for you and dependents • Company-provided equipment • Wellbeing, always-be-learning and home office allowances • Frequent team get togethers • Great diverse & inclusive people-first culture
Apply NowDiscover 100,000+ Remote Jobs!
Wall of Love
Frequently asked questions
We use powerful scraping tech to scan the internet for thousands of remote jobs daily. It operates 24/7 and costs us to operate, so we charge for access to keep the site running.
Of course! You can cancel your subscription at any time with no hidden fees or penalties. Once canceled, you’ll still have access until the end of your current billing period.
Other job boards only have jobs from companies that pay to post. This means that you miss out on jobs from companies that don't want to pay. On the other hand, Remote Rocketship scrapes the internet for jobs and doesn't accept payments from companies. This means we have thousands more jobs!
New jobs are constantly being posted. We check each company website every day to ensure we have the most up-to-date job listings.
Yes! We’re always looking to expand our listings and appreciate any suggestions from our community. Just send an email to Lior@remoterocketship.com. I read every request.
Remote Rocketship is a solo project by me, Lior Neu-ner. I built this website for my wife when she was looking for a job! She was having a hard time finding remote jobs, so I decided to build her a tool that would search the internet for her.