Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Network message monitoring and collection #712

Closed
Kubuxu opened this issue Oct 9, 2024 · 2 comments
Closed

Network message monitoring and collection #712

Kubuxu opened this issue Oct 9, 2024 · 2 comments
Assignees
@masih @Kubuxu
Milestone
M3: Mainnet Activ...

Comments

@Kubuxu
Copy link
Contributor

Kubuxu commented Oct 9, 2024 •
edited
Loading

Set up network message monitoring and collection for the purpose of post-factum analysis and metric collection.
Current idea is based on the parquet data format, f3 observe command and duckdb for parquet processing.

  • f3 observe to collect messages
  • maybe improve f3 observe to include message validation
  • periodically upload the parquet files to S3
  • build a script to download parquet files for time range, compact and optimize them to ease analysis
@github-project-automation github-project-automation bot moved this to Todo in F3 Oct 9, 2024
@Kubuxu Kubuxu self-assigned this Oct 9, 2024
@masih masih self-assigned this Oct 25, 2024
@masih
Copy link
Member

masih commented Nov 19, 2024

Done in #744

@masih masih closed this as completed Nov 19, 2024
@github-project-automation github-project-automation bot moved this from Todo to Done in F3 Nov 19, 2024
@BigLep
Copy link
Member

BigLep commented Nov 19, 2024

Handled by #744
Followup happening in #745

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@masih masih

@Kubuxu Kubuxu

Labels
None yet
Projects
F3
Status: Done
Milestone
M3: Mainnet Activation
Development

No branches or pull requests
3 participants
@BigLep @masih @Kubuxu