Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Snapshot overflow #267

Open
hackerwins opened this issue Nov 4, 2021 · 3 comments · May be fixed by #1077
Open

Snapshot overflow #267

hackerwins opened this issue Nov 4, 2021 · 3 comments · May be fixed by #1077
Labels
bug 🐞 Something isn't working enhancement 🌟 New feature or request good first issue 🐤 Good for newcomers

Comments

@hackerwins
Copy link
Member

hackerwins commented Nov 4, 2021 •
edited
Loading

What happened:

If a document's snapshot exceeds 16 MB, the following error occurs:

2021-11-04T06:17:47.355Z	ERROR	an inserted document is too large
github.com/yorkie-team/yorkie/yorkie/backend/db/mongo.(*Client).CreateSnapshotInfo
	/app/yorkie/backend/db/mongo/client.go:371
github.com/yorkie-team/yorkie/yorkie/packs.storeSnapshot
	/app/yorkie/packs/packs.go:418
github.com/yorkie-team/yorkie/yorkie/packs.PushPull.func1
	/app/yorkie/packs/packs.go:150
github.com/yorkie-team/yorkie/yorkie/backend.(*Backend).AttachGoroutine.func1
	/app/yorkie/backend/backend.go:164
2021-11-04T06:17:47.366Z	ERROR	an inserted document is too large
github.com/yorkie-team/yorkie/yorkie/packs.PushPull.func1
	/app/yorkie/packs/packs.go:155
github.com/yorkie-team/yorkie/yorkie/backend.(*Backend).AttachGoroutine.func1
	/app/yorkie/backend/backend.go:164

This is because there is a limit on the size of documents in MongoDB.

To store documents larger than the maximum size, MongoDB provides the GridFS API. See mongofiles and the documentation for your driver for more information about GridFS.

It might be a good idea to check if we can use GridFS.

What you expected to happen:

How to reproduce it (as minimally and precisely as possible):

Anything else we need to know?:

Environment:

  • Operating system:
  • Browser and version:
  • Yorkie version (use yorkie version):
  • Yorkie JS SDK version:
@hackerwins hackerwins added bug 🐞 Something isn't working enhancement 🌟 New feature or request labels Nov 4, 2021
@hackerwins hackerwins mentioned this issue Nov 10, 2021
Open
@hackerwins hackerwins moved this to Todo in v0.2 Nov 17, 2021
@hackerwins hackerwins added this to v0.2 Nov 17, 2021
@hackerwins hackerwins removed this from v0.2 Dec 14, 2021
@hackerwins hackerwins added this to v0.3 Dec 14, 2021
@hackerwins hackerwins moved this to Todo in v0.3 Dec 14, 2021
@hackerwins hackerwins added the good first issue 🐤 Good for newcomers label May 14, 2022
@heka1024
Copy link
Contributor

Could you assign this issue to me? cc. @dc7303

@dc7303
Copy link
Member

dc7303 commented Jul 17, 2022

@heka1024 Sure. 😄

@hackerwins hackerwins removed this from v0.3 Jun 6, 2023
@hackerwins hackerwins moved this to Backlog in Yorkie Project - 2024 Aug 20, 2024
@xx10222 xx10222 linked a pull request Nov 24, 2024 that will close this issue
Draft
3 tasks
@injae-kim
Copy link

Fix PR: #1077

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug 🐞 Something isn't working enhancement 🌟 New feature or request good first issue 🐤 Good for newcomers
Projects
Yorkie Project - 2024
Status: Backlog
Yorkie Project
Status: Todo
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fix mongo db client to use GridFS API on 16MB exceed file xx10222/yorkie
4 participants
@hackerwins @injae-kim @dc7303 @heka1024