Hi! I’m trying to archive papers as soon as they appear in a scientific journal, and I’ve attempted to search for PDF links on each page using some regular web scraping.

The problem is that most of these journals will add their fancy PDF readers, and downloading the file is not as straight-forward as it seems. However, the Zotero Connector works flawlessly when you trigger the extension. Therefore, I attempted to set up a selenium instance with this extension to download the papers given a link, but I struggle to actually get the extension to trigger. I tried sending a Shift + Ctrl + S command, but that doesn’t seem to get picked up. Similarly, I can’t figure out how to call the extension from the console.

Did anyone else attempt such a workflow before? Am I doing something completely unnecessary, as there are better options available? Help a fellow sailor out. Thanks a lot in advance for your help!