Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: mismatch between number of campuses in database and API resulting to an error #516

Open
1 task done
42atomys opened this issue Sep 21, 2023 · 2 comments
Open
1 task done
Labels
aspect/backend 💻 Concerns the backend code in the repository domain/complicated 🟨 The relationship between cause and effect requires analysis or expertise good first issue Good for newcomers priority/medium 🟨 Priority 3 - Not blocking but should be fixed soon stale/lock 🔒 This prevent slote process on this object type/bug 🔥 Something isn't working

Comments

@42atomys
Copy link
Owner

Describe the bug

An error generated: campus not found is raised during the execution of the webhooks-processor. This error is undesirable as we crawl all campuses each week.
Upon investigation, it was discovered that there is a mismatch between the number of campuses in our production database and the number returned by the API. The production database contains 51 campuses, while the API returns 69. The cause of this mismatch is currently unknown.

Investigating and resolving this mismatch is crucial to ensure the accuracy and reliability of the data in our system. The mismatch leads to the campus not found error during the webhooks-processor, which could potentially impact other functionalities.

To Reproduce

  1. Run the command go run main.go jobs crawler campus
  2. Observe the discrepancy between the number of campuses returned by the API and the number inserted into the database.

Expected behavior

The data between the API and our database should match.

Relevant log output

10:25PM INF Start the crawling of all campus of 42 network version=v0.30
10:25PM DBG Requesting https://api.intra.42.fr/v2/campus?per_page=100 version=v0.30

... TRUNC DATA DUE TO PRIVATE INFORMATION ...

10:37PM INF Successfully imported 51 campus version=v0.30

Version of software

v0.30

Environment

Live (https://s42.app)

Additional context

Error Message: generated: campus not found
Link to Discord message from monitoring

Code of Conduct

  • I agree to follow this project's Code of Conduct
@42atomys 42atomys added good first issue Good for newcomers priority/medium 🟨 Priority 3 - Not blocking but should be fixed soon aspect/backend 💻 Concerns the backend code in the repository domain/complicated 🟨 The relationship between cause and effect requires analysis or expertise type/bug 🔥 Something isn't working labels Sep 21, 2023
@github-actions
Copy link

This issue is stale because it has been open for 28 days with no activity.

@github-actions github-actions bot added the stale/stale 🦴 This is stale because it has been open for 30 days with no activity. label Oct 20, 2023
@42atomys
Copy link
Owner Author

@42atomys 42atomys added stale/lock 🔒 This prevent slote process on this object and removed stale/stale 🦴 This is stale because it has been open for 30 days with no activity. labels Oct 24, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
aspect/backend 💻 Concerns the backend code in the repository domain/complicated 🟨 The relationship between cause and effect requires analysis or expertise good first issue Good for newcomers priority/medium 🟨 Priority 3 - Not blocking but should be fixed soon stale/lock 🔒 This prevent slote process on this object type/bug 🔥 Something isn't working
Projects
Status: Confirmed/To Do💜
Development

No branches or pull requests

1 participant