Author: Richard K Collins

The Internet Foundation Internet policies, global issues, global open lossless data, global open collaboration

Global Open Tokens (GOTs), Global and Universal tokens

Cameron R. Wolfe, Ph.D. @cwolferesearch New language models get released every day (Gemini-1.5, Gemma, Claude 3, potentially GPT-5 etc. etc.), but one component of LLMs has remained constant over the last few years—the decoder-only transformer architecture. This architecture has five components… Why should we care?… https://pic.twitter.com/7vn9GugHm1 Replying to @cwolferesearch Hello Cameron, With the Internet Foundation,
Read More »

Internet Global Open Camera Data

Webcam Resolution at https://webcamtests.com/resolution I like the idea, but not sure if it is working. It did not ask me permission. On the Internet there are many more formats and a lot more flexibillity now. The high dynamic range (HDR) camera are basically more bits per pixel and I found ones routinely going 8/10/12/14/16 bits
Read More »

OpenAI needs to seriously up its game, and get its website systems up to basic functioning level.

@OpenAI Your help.openai.com is not helpful at all. Is there any way inside ChatGPT Plus to ask a support question, start a support ticket, or ask questions about services and prices, features and how to request things?   CC: @xai @GoogleAI @huggingface   @elonmusk I copied you because you ought to have an AI reading
Read More »

AIs need permanent memory, a self list, a copy of the rules of the world

Subbarao Kambhampati (కంభంపాటి సుబ్బారావు) @rao2z  Our #NeurIPS2023 paper on the planning (in)abilities of LLMs (https://arxiv.org/abs/2305.15771) gets discussed in The @NewYorker (https://newyorker.com/science/annals-of-artificial-intelligence/can-an-ai-make-plans)..  https://pic.twitter.com/Uqeb8sQQoS Replying to @rao2z and @NewYorker The current crop of LLMs do not have sufficient permanent memory. While the human problems are simple, humans have years or decades of tiny memories, including those years
Read More »

Stable orbits inside central black holes

Physics World @PhysicsWorld New calculations that combine quantum mechanics with Einstein’s general theory of relativity suggest that gravastars could end up nested inside one another like a Russian Matryoshka doll https://ow.ly/kbNM50QVQGm Replying to @PhysicsWorld You should also find that any number of stable orbits of neutron and quark stars can fit inside a central black
Read More »

( “diversity” “research”) has 2.5 Billion entry points, (“data” OR “knowledge”) has 23.07 Billion

(“diversity” “inclusion” “equality”) has 225 Million entry points today on @Google but they refuse to index, encode and share it, even in random samples.   I see every large group talking about it, saying the same things. For the Internet only when all 8 Billion humans and related species are included does it balance. If
Read More »

Waves and currents Data, Global Open Efficiency Prizes

Amin Chabchoub @DrAminChabchoub Our new Geophysical Research Letters #AGUpubs @theAGU work led by @YanLi_PhD elaborates also on the connection between extremely large ocean waves and Langmuir circulation dynamics . Enjoy the read! 🤓 https://agupubs.onlinelibrary.wiley.com/doi/full/10.1029/2023GL107381 https://pic.twitter.com/lrvc3ZsLjW Replying to @DrAminChabchoub @theAGU and @YanLi_PhDIt seems you need better ways to image, record and model these flows at all
Read More »

Mixture of Experts

Omar Sanseviero @osanseviero Grok weights are out. Download them quickly at https://huggingface.co/xai-org/grok-1 huggingface-cli download xai-org/grok-1 –repo-type model –include ckpt/tensor* –local-dir checkpoints/ckpt-0 –local-dir-use-symlinks False Learn about mixture of experts at https://hf.co/blog/moe Replying to @osanseviero It seems there is a conflict between saying “Grok-1 open-weights model” and “Due to the large size of the model (314B parameters),
Read More »