Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add daily-caching for the arxiv query service #61

Open
liadmagen opened this issue Oct 7, 2018 · 0 comments
Open

Add daily-caching for the arxiv query service #61

liadmagen opened this issue Oct 7, 2018 · 0 comments
Labels
enhancement 🚀 New feature or request good first issue 🆕 Good for newcomers Hacktoberfest For the Hacktoberfest challenge help wanted ✋ Extra attention is needed

Comments

@liadmagen
Copy link
Member

Arxiv.org updates the papers once a day. Multiple requests in a short period of time 'wastes' the arxiv server by re-querying data.

A solution for this would be daily-caching of the results, so that new requests won't need to re-reach the arxiv, and therefore will be faster to execute.

The caching should contain a date timestamp, it can be saved as a file on the disk (.json) which will be deleted when expired (after 24h), when a new request checks the file existence and deletes it if it's older than 24H. If the file is newer than that, its content should be read and sent back to the client.

This is a good issue for making the architecture decisions of where to place which code.

@liadmagen liadmagen added enhancement 🚀 New feature or request help wanted ✋ Extra attention is needed good first issue 🆕 Good for newcomers Hacktoberfest For the Hacktoberfest challenge labels Oct 7, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement 🚀 New feature or request good first issue 🆕 Good for newcomers Hacktoberfest For the Hacktoberfest challenge help wanted ✋ Extra attention is needed
Projects
None yet
Development

No branches or pull requests

1 participant