Today's Open Source (2024-08-15): THUDM Tsinghua Releases LongWriter, Capable of Writing 10,000-Word Texts

Explore the latest AI open-source projects, including ultra-long text generation, multimodal models, vector searches, engineering tools, and scientific research assistants.

Aug 15, 2024

Here are some interesting AI open-source models and frameworks I wanted to share today:

Project: LongWriter

LongWriter is an open-source ultra-long context model from THUDM, Tsinghua University. It can generate texts over 10,000 words long.

The project offers two models: LongWriter-glm4-9b and LongWriter-llama3.1-8b. They are trained on GLM-4-9B and Meta-Llama-3.1-8B, respectively.

LongWriter is ideal for applications needing lengthy content, such as storytelling, academic writing, and detailed reports.

https://github.com/THUDM/LongWriter

https://arxiv.org/abs/2408.07055

Project: Idefics3

Idefics3 is HuggingFace's third-generation open-source multimodal model. It accepts any sequence of images and text as input and generates text output.

The model can answer questions about images, describe visual content, create stories based on multiple images, or function as a pure language model.

Compared to Idefics1 and Idefics2, Idefics3 shows significant improvements in OCR, document understanding, and visual reasoning.

https://huggingface.co/HuggingFaceM4/Idefics3-8B-Llama3

Project: pgvector

pgvector is an open-source Postgres extension for vector similarity search.

It supports exact and approximate nearest-neighbor searches. It handles single-precision, half-precision, binary, and sparse vectors. It offers various distance metrics like L2, inner product, cosine, L1, Hamming, and Jaccard distances.

The project also includes Postgres's features like ACID compliance, point-in-time recovery, and JOIN operations.

https://github.com/pgvector/pgvector

Project: Omni Engineer

Omni Engineer is an open-source project aiming to provide developers with a versatile set of engineering tools.

Its goal is to simplify the software development process, especially when building and managing complex systems.

Omni Engineer offers tools that enhance developer efficiency at various stages, including code generation, testing, and deployment.

https://github.com/Doriandarko/omni-engineer

Project: OpenResearcher

OpenResearcher is an advanced AI assistant for scientific research. It aims to provide helpful answers to research queries. By accessing the arXiv corpus, it offers users the latest scientific insights.

https://github.com/GAIR-NLP/OpenResearcher

https://arxiv.org/abs/2408.06941