Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

collation support... #50

Open
surebee opened this issue Sep 3, 2014 · 2 comments
Open

collation support... #50

surebee opened this issue Sep 3, 2014 · 2 comments

Comments

@surebee
Copy link

surebee commented Sep 3, 2014

twitter-cldr-rb do have support for case folding, normalization and collation. Are there plans to port these features into twitter-cldr-js as well ?

@camertron
Copy link
Collaborator

Hey @surebee,

As a matter of fact, yes. The awesome and talented @radzinzki may work on porting some or all of those in the future. The biggest obstacle we face is getting all the unicode data into Javascript land. As @radzinzki discovered while porting text segmentation (see #47), the combined metadata for each character in unicode can take up quite a bit of space (on the order of 2mb) and is therefore not suitable for transmission to a browser. He's working on a way to better compress the data, which should enable us to continue porting additional twitter-cldr-rb features.

It's worth noting that, even if we can compress unicode metadata effectively, we likely will not be able to do so with collation data due once again to size constraints (collation data weighs in at 5mb). Case folding and normalization may be possible.

@arnavk
Copy link
Contributor

arnavk commented Sep 4, 2014

Thanks for the kind words, @camertron. Collation an the other features are in my to-do list and I hope to get to them soon. As @camertron said, bundle size is an important factor to be considered. If the data is too big and can't be effectively compressed, collation could be an opt-in plug in.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants