Apply

Renting Offshore Compute for a Private AI

Short answer: A model worth using needs a graphics card that costs more than a car, so you rent one by the hour from a marketplace where private owners and small data centers list machines. Some are outside the US, and many take crypto. The risk is in the host's terms and in how fast the host list moves.

Part of What it takes to do this yourself โ€” the DIY guide from Freeborn Labs.

Why people rent compute this way

The full guide, What it takes to do this yourself, starts here for a plain reason: a graphics card big enough for a model worth using costs more than a car. Renting by the hour from a marketplace is how a person gets that machine without buying it.

The marketplaces in this step are decentralized in the guide's words: private owners and small data centers list machines, some of them outside the US. That is also why payment and rules work differently here than on a mainstream cloud โ€” a point the next steps, on paying hosts and on failover, keep coming back to.

What to look for before you pay

Search for 'GPU rental marketplace', 'H200 per hour' and 'bare metal GPU', and compare what comes up. Before you pay, read each host's terms for 'adult', 'NSFW' and 'prohibited content'. Some hosts ban that work outright and close the account without warning, so the terms are not fine print to skip โ€” they decide whether the build survives its first week.

Check the machine itself, not just the listing. The guide names the traps: unverified machines, slow disks, and boxes that are listed but out of stock.

The risks the guide names

A host can change its rules after you have uploaded your data. That single risk shapes the rest of the build: it is why your data needs to be backed up somewhere you control, and why failover to a second host is a step of its own rather than an afterthought.

This step also never really ends. The host list keeps moving, which is why the guide budgets time for it every week, not only at the start.

The hours, as estimated on the pillar page

First time: about 15 to 30 hours. Then about 1 to 2 hours a week, because the host list keeps moving. These are the pillar page's estimates, not measured data, and they assume you have built software before. If you have not, add time.

Related DIY pages

Back to the pillar: What it takes to do this yourself

Apply

Adults only (18+). What it takes to do this yourself ยท Apply