i have a list of links to the member pages in a text file
https://www.example.org/forum/members/list/?page=2
https://www.example.org/forum/members/list/?page=3
https://www.example.org/forum/members/list/?page=4
https://www.example.org/forum/members/list/?page=5
etc
there's 20 member names for every page and their names are clickable
their profile link is what i'm after
https://www.example.org/forum/members/username.9308/
i want from the page links to extract the last part of their profile address "username.9308" and save it as
username:9308
in a text file
i have a list of 1000 page links and there's 20000 usernames on them
it can work with regex
it will read the txt file i attached and save the usernames and numbers to a text file as a list.
extract forum members profile link from member page link
extract forum members profile link from member page link
- Attachments
-
- links to member pages.txt
- (18.88 KiB) Downloaded 15 times
Re: extract forum members profile link from member page link
Is there a legitimate reason to do this?
Re: extract forum members profile link from member page link
@gregster - with forum-related posts like this… viewtopic.php?p=453331#p453331
Re: extract forum members profile link from member page link
Not sure what that other request can tell me - besides, posts and profile pages are pretty different things (and this new request here is not even about a phpBB forum).
Imo, we wouldn't want this kind of automated crawling/scraping, done by random people, on our own forums - should we then support this when it's done on other forums?
Imo, we wouldn't want this kind of automated crawling/scraping, done by random people, on our own forums - should we then support this when it's done on other forums?
Re: extract forum members profile link from member page link
i have the member list already but i plan to add "Last seen" time and date, i will sort with recent online and add them as friendsgregster wrote: ↑03 Jul 2022, 22:58Not sure what that other request can tell me - besides, posts and profile pages are pretty different things (and this new request here is not even about a phpBB forum).
Imo, we wouldn't want this kind of automated crawling/scraping, done by random people, on our own forums - should we then support this when it's done on other forums?
Re: extract forum members profile link from member page link
this one was a project about adding posts of forum directly from the mysql databaseBoBo wrote: ↑03 Jul 2022, 22:29@gregster - with forum-related posts like this… viewtopic.php?p=453331#p453331
Re: extract forum members profile link from member page link
Spamming over 20,000 members of a forum doesn’t sound legitimate to me. If you did that on this site, it would earn you an instant perma-ban.
I think we have heard enough to lock this thread.