OnlyFans Data Scraper
There are a number of reasons why you may want to scrape data from OnlyFans, but we’ll assume it’s strictly for business and you’d like to analyze the earnings potential of OnlyFans profiles & collect engagement statistics as well as contact details like websites for OnlyFans profiles.
We’ll show you how to do this without violating the OnlyFans Terms of Service using a little-known technique involving HAR files. These allow us to record our web traffic as we legally interact with OnlyFans (without violating their Terms of Service), and the web scraping is done on this recording of web traffic instead of on their actual website.
1. Browse OnlyFans Profiles
Start by heading to an OnlyFans profile. To avoid showing you anything too spicy, we’ll use the official OnlyFans Profile in this example, but this will work with any OnlyFans profile you have access to.
On the profile page, right click somewhere on the page and hit “Inspect” to open up developer tools, which will begin recording the network traffic that OnlyFans sends to your browser. We’ll use this recording to perform the scraping on instead of the OnlyFans website as to not be subject to the Terms of Service.
To browse multiple profiles (e.g. if you have a list of profiles), you’ll need to manually enter them into the same browser tab that you have developer tools open. Make sure that you have Preserve log checked, this way as you enter multiple URLs into the browser, you will continue recording the data between page loads.
Scrape Posts & Media
If you instead care more about scraping the posts (or videos) of a specific creator, you simply just need to scroll down through their posts while you have developer tools open. This will record the posts as they are sent to your browser. For photos & videos, you will be able to capture the video URLs & thumbnail URLs of the content. Do with those URLs as you wish, but accessing them outside of an official OnlyFans client may be against their Terms of Service.
2. Export a HAR File
When you’re done browsing through the OnlyFans profiles you want to scrape (or media), go to the “Network” tab under developer tools in your web browser and click the down arrow labeled “Export HAR…” to download a HAR file containing a recording of the raw data that OnlyFans sent to your browser. Then upload that file to the HAR File Web Scraper and look for the following group to scrape profile details:
You may need to scroll down a bit to find this group, it should start with /api2/v2/users/ and if scraping multiple users, you’ll see their profile URLs listed in the “Refering URLs” section. Click “Parse Group” to see their data.
3. Download Profile Data
On the parsed data screen, you’ll want to look for the “root” collection which will have a row for each profile.
One very interesting column is the referalBonusSummForReferer column, which typically lists a large number (in the tens of thousands) and seems to suggest that this is the total amount of money the creator has earned. However, we can’t be 100% sure as this is an undocumented API that powers the OnlyFans website… it may literally be a random number for all we know.
Below is a summary of some of the more interesting fields we’re able to capture for each profile.
- OnlyFans ID
- Name
- Profile Photo URL
- Header Photo URL
- Username
- Verified?
- Monetized
- Tips Min & Max
- Subscription Price
- Unprofitable (we’re not sure what this means, but it’s a column name)
- Date Joined
- Able to Refer
- Profile
- Link to Website
- Link to Wishlist
- Location
- Number of Posts
- Archived Post Count
- Private Post Count
- Photos Count
- Videos Count
- Last Online Timestamp
- Favorited Count
- Subscriber Count
- Call Price
- Referal Bonus Sum
- Finished Live Stream Count