Scraping the Fansly API
If you need to scrape Fansly for influential profiles or content engagement stats, we’ll show you how to legally do so without violating the Fansly Terms of Service using HAR files.
This will let you scrape data from Fansly (while logged in if you’d like) without ever being detected as the scraping occurs on a recording of your web traffic instead of the actual Fansly website.
Scrape Fansly Hashtags
To scrape a list of users posting with a particular hashtag or scrape the posts using that hashtag, head to any Fansly hashtag page like this Hashtag Page for Public (NOT SAFE FOR WORK) to view the content.
You can navigate to any hashtag page you want and don’t need to be logged in to view content. However, if logged in then you’ll be able to scroll and view more posts and profiles than if logged out. We’ll show you below how to scrape this content using HAR files.
1. Browse Hashtags
On the hashtag page you’d like to scrape, right click on the web page and click “Inspect” to open up developer tools. This will begin recording your web traffic as you use the Fansly website in compliance with their Terms of Service.
Now refresh the web page to force the Fansly API to resend its content to your browser now that you’re recording what it’s sending. You can then scroll down through the posts to have the API load more and more posts until you get through enough.
2. Export a HAR File
After scrolling through enough hashtag posts, look for the “Network” tab in developer tools and click the down arrow labeled “Export HAR…” to download a HAR file containing a copy of all the raw network data that was sent to your browser.
Then upload that file to the HAR File Web Scraper to parse the HAR file securely in your browser. Then look for the group as pictured above, ending in suggestionsnew (subject to change) or the one with similar fields in it, e.g. accountId, mediaId etc… and click “Parse Group” to extract out and combine the data.
3. Download Hashtag Data
The parsed data page will show you 2 sets of interesting data: the accounts who posted with the hashtag and the actual posts with captions. Both sets of data will include engagement stats for either the Fansly user or the content respectively.
Hashtag Post Profiles
If you look for the response › aggregationData › accounts collection, you’ll see all of the accounts who posted with the hashtag you browsed.
Some notable fields you may be interested are listed below:
- Username
- Display Name
- Flag Count
- Account Creation Time
- Follow Count
- Total Post Likes
- Bio Text
- Location
- Last Online Timestamp
- Total Media Likes
- Number of Images Posted
- Number of Videos Posted
- Image URL to Profile Photo & Banner
- Live Streaming Information
- Available Subscription Plans & Pricing
Hashtag Posts
If you instead care about seeing the other posts containing the hashtag of interest (perhaps to get some content inspiration), you can look for the response › aggregationData › posts in the “All Collections” tab on the HAR Parse screen.
Notable fields you’ll get in the response are:
- Author Account ID
- Created Timestamp
- Post Caption
- Like Count
- Reply Count
- Media Like Count
Scrape Fansly Profile Posts
If you’re more interested in scraping all of the posts from a Fansly account, you can do so using the same approach as outlined above. Just browse to the profile, here is a Sample Fansly Profile (NOT SAFE FOR WORK) with public content.
1. Browse Profile Timeline
On the profile page, right click on the page and hit “Inspect” to open up developer tools, which will begin recording your web traffic. Now refresh the page to get the Fansly API to re-send its data now that you’re recording it.
Now scroll down through all the posts to get the API to keep sending you more data. Scroll through as many posts as you’d like to scrape.
2. Export HAR File
When you’ve browsed through enough content, go to the “Network” tab under developer tools and click the down arrow labeled “Export HAR…” to download a HAR file containing all of the raw data we just browsed through.
Upload that file to the HAR File Web Scraper and look for the group starting with /api/v1/timelinenew (or similar) and contains fields like content, createdAt, etc… and click “Parse Group” to combine and parse the response data into downloadable collections.
3. Download Timeline Data
When the parse finishes, look for the collection labeled response › posts (you may need to scroll down to find it) and you’ll see the posts for that profile.
The fields will be the same as the post fields mentioned earlier, containing the following columns of interest:
- Author Account ID
- Created Timestamp
- Post Caption
- Like Count
- Reply Count
- Media Like Count
Tipping & Financial Data
While scraping the Fansly website in this walkthrough, we did so as a logged-out user. However, we did notice a few fields in the API responses mentioning total tip amounts and number of subscribers (paid we’re assuming). All of these values were zero though, so it’s possible they either removed this data entirely from their API or only selectively surface it to logged-in or paying users.
So if you’re after this sort of financial data, be sure to look for these fields when you attempt the scrape and don’t be afraid to try while logged in to your Fansly account, as the API may surface more information than it shows here as we only performed the HAR file creation as a logged out user.