Off topic discussion • Re: What happened to my old account

First obstacle appears to be that the server won't serve up the "User's Posts" pages when scraping 2,117,543 posts but only 313,912 topics, though many multi-page -- perhaps scrape the whole lot ?

You can click on "my posts"

search.php?search_id=egosearch

This shows all threads that you've participated in dating back to the first post.

But only if you are logged in via a browser or can fake it to look that way. And, with hundreds of pages presented it really needs to be automated retrieval. That's why I tried downloading User's Posts where you can specify the Member ID -

• https://forums.raspberrypi.com/search.php?sr=posts&author_id=number

I was hoping to do that as Step 1, identify all the User Post pages and download those as Step 2, parse those to find post numbers and download those as Step 3, maybe parse again and download the entire threads as Step 4.

But that didn't work, I was thwarted at the first hurdle.

It also seems I can't download threads using -

• https://forums.raspberrypi.com/viewtopic.php?t=number

There may be ways round this but it's not my area of expertise.

Statistics: Posted by hippy — Sun Aug 04, 2024 1:38 pm

---