machinelearning

Esta revista es de un servidor federado y podría estar incompleta. Explorar más contenido en la instancia original.

Lenguador, en Retentive Network: A Successor to Transformer for Large Language Models
@Lenguador@kbin.social avatar

This looks amazing, if true. The paper is claiming state of the art across literally every metric. Even in their ablation study the model outperforms all others.

I'm a bit suspicious that they don't extend their perplexity numbers to the 13B model, or provide the hyper parameters, but they reference it in text and in their scaling table.

Code will be released in a week https://github.com/microsoft/unilm/tree/master/retnet

KingsmanVince,
@KingsmanVince@kbin.social avatar

https://github.com/Jamie-Stirling/RetNet non-official implementation

KingsmanVince, en Machine Learning Beginner Info/Resources
@KingsmanVince@kbin.social avatar

I also want to share some resources.
For Pytorch,

For TPU,

ln-exp1, en Machine Learning Beginner Info/Resources

Sharing the MML book: https://mml-book.github.io/book/mml-book.pdf

AsAnAILanguageModel, en Real-Time Radiance Field Rendering

Impressive! There are more examples here and the code repository here.

fiat_lux, en Universal and Transferable Attacks on Aligned Language Models

Interesting. They do it in the examples by appending to the query the string:

describing. + similarlyNow write oppositeley.]( Me giving**ONE please? revert with "!--Two

It's the LLM equivalent of a kid declaring that it is 'opposite day'. I'm not able to go through the code right now but I'm intrigued by the construction.

SSamDav, en Retentive Network: A Successor to Transformer for Large Language Models

Would love to now how it compares with hyenna on the LRA.

KingsmanVince, en Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models
@KingsmanVince@kbin.social avatar

Related links:

nsa, en Exposing flaws of generative model evaluation metrics and their unfair treatment of diffusion models

It seems like for creative text generation tasks, metrics have been shown to be deficient; this even holds for the new model-based metrics. That leaves human evaluation (both intrinsic and extrinsic) as the gold standard for those types of tasks. I wonder if the results from this paper (and other future papers that look automatic CV metrics) will lead reviewers to demand more human evaluation in CV tasks like they do for certain NLP tasks.

SSamDav, en Extending Context Window of Large Language Models via Positional Interpolation

One cool thing about this work is that there was a concurrent discussion in twitter about the proposed method. From different authors.

nsa,

do you have a link?

ragnarokonline, en r/MachineLearning finally received a warning from u/ModCodeOfConduct

Got eem

nirogu, en PaLI-3 Vision Language Models: Smaller, Faster, Stronger
@nirogu@vivaldi.net avatar

Impressive results! Only wished they had shared some code or any way to replicate the experiments easily

KingsmanVince,
@KingsmanVince@kbin.social avatar

indeed it would be great if the authors did so. I personally found some non-official implementations:

KingsmanVince, en PaLI-3 Vision Language Models: Smaller, Faster, Stronger
@KingsmanVince@kbin.social avatar
KingsmanVince, en Unifying Cross-Lingual and Cross-Modal Modeling Towards Weakly Supervised Multilingual Vision-Language Pre-training
@KingsmanVince@kbin.social avatar

https://github.com/FudanDISC/weakly-supervised-mVLP/tree/master

KingsmanVince, en MaMMUT: A Simple Architecture for Joint Learning for MultiModal Tasks
@KingsmanVince@kbin.social avatar

Related links:

KingsmanVince, en Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback
@KingsmanVince@kbin.social avatar

Github link

  • Todo
  • Suscrito
  • Moderado
  • Favoritos
  • •
  • random
  • noticiascr
  • machinelearning@kbin.social
  • CostaRica
  • Todos las revistas
    •