LlamaParse Roadmap

[jerryjliu]

Currently LlamaParse supports complex PDF documents as input. We will extend LlamaParse in the coming weeks / months to support the following:

• More file formats, starting with .docx and .pptx coming this month.
• Ability to retrieve image embeded in document coming this month.
• More output format better suited for Retrieval augmented generation than Markdown.
• Better support for complexe document layouts, including graphs and pie charts.
• Vertical specific document parser starting with Financial documents, invoices, forms and contract.

Of course, we will also work hard to address any issue that may arise. Please drop in the Issues tab!

[jamesqiyucai]

When will LlamaParse support Chinese?

[hexapode]

LlamaParse already support chinese. You should specify language=ch_sim or language= ch_trad in the api parameters. Once #37 is merged, you should be able to do it with the python pluggin.

[DMAgit]

Is the source code of the parsing logic itself available, or will it be made available? As far as I can see, currently only the code which accesses the remote point is available, but not any of the parsing logic.

[relsas]

Testing on Academic Papers

Hi, I very much appreciate the initiative on LlamaParse as pdf-parsing is indeed a challenge. Putting this as an API is also cool and solves many installation issues. The idea of using LLM instructions to steer the parser is great, as is the separation of objects for tables and figures.
However, I've now spent quite some time on testing to parse academic papers, with mediocre success only. In particular, the following issues occur:

• A new page in the pdf always breaks the current paragraph, such that often sentences are interrupted and continued in the next paragraph.
• If the pdf has footer or header information, this is repeated over an over, sometimes even classified as headers. Such footer info is then put between the body text when the page switch occurs, so that one cannot reconstruct interrupted sentences/paragraphs (see above)
• Footnotes are not systematically recognized, numeration is in most cases lost, and sometimes footnotes appear in the body text
• Formulas are barely translated to Latex.

In most of these aspects, parsing by Nougat works much better (though this has problems on its own...e.g. with references or left out pages).
Any ideas (or maybe plans) how to improve model performance on such complex types of pdfs?
Kind regards

[gittar]

Will there be LlamaParse on prem, i.e. a version which can be run locally without API calls? This would make its use für confidential documents possible. Also a "No"-answer would be helpful for decision making.

[martincolladodev]

I think that the "No" answer is an essential aspect. I'm trying to see on forums, google searches, etc. what are the decisions that you made on your platform about the data privacy in this product and is difficult to view a clear answer.

Could you provide more information about it @hexapode ? I don't think that any company out there will throw private and sensitive information on this API before being aware of what's happening with their data.

[jordanparker6]

@hexapode would love to know if this feature is roadmapped. Would help to understand potential licensing costs if this were to be part of an on-prem stack for enterprise.

[guillaume-millot]

I have tried Llama Parse to parse complex financial documents. I found it to be a great and innovative tool.
However, often, it makes basic mistakes such as completely ignoring a big portion of the PDF.
It'd really be the best tool if it were more robust. Curious to know how much you're investing on llama parse core improvements vs other things.
Thank you!

[LDD19]

Better support for complex document layouts, including graphs and pie charts.

Any plans to integrate this in the near future? Especially with GPT-4o being multimodal, filling the missing data in parsed charts/images shouldn't be an issue.

[aifirstd3v]

My PDF only has images :) I hope LlamaParse can read image :)