AI Today

Github: https://arxiv.org/pdf/2411.00640 This research paper advocates for incorporating rigorous statistical methods into the evaluation of large language models (LLMs). It introduces formulas for calculating standard errors and confidence intervals, emphasizing the importance of accounting for clustered data and paired comparisons between models. The paper details variance reduction techniques,...

Paper: https://arxiv.org/pdf/2411.14405 Github: https://github.com/AIDC-AI/Marco-o1 The Alibaba MarcoPolo team introduces Marco-o1, a large reasoning model designed to excel in open-ended problem-solving, unlike previous models which primarily focused on tasks with readily available answers. Marco-o1 uses Chain-of-Thought fine-tuning, Monte Carlo Tree Search (MCTS), and innovative reasoning strate...

Github: https://github.com/black-forest-labs/... Black Forest Labs announced FLUX.1 Tools, a suite of four open-access and API-based models enhancing their FLUX.1 text-to-image model. FLUX.1 Fill excels at inpainting and outpainting, exceeding existing tools. FLUX.1 Canny and FLUX.1 Depth offer structural guidance using edge and depth maps, respectively, outperforming competitors. Finally, FLUX.1...

Blog: https://allenai.org/blog/tulu-3 Summary The Allen Institute for Artificial Intelligence (Ai2) has released Tülu 3, an open-source family of post-trained language models. Unlike closed models from companies like OpenAI, Tülu 3's training data, methods, and code are publicly available, allowing researchers to replicate and build upon the work. This release aims to bridge the performance gap be...

Paper: https://arxiv.org/pdf/2411.14402 Github Link: https://github.com/apple/ml-aim This research introduces AIMV2, a family of large-scale vision encoders pre-trained using a novel multimodal autoregressive method. Unlike previous contrastive methods, AIMV2 simultaneously predicts image patches and text tokens, offering scalability and simplicity. The resulting models demonstrate strong performa...