All languages transmit information at roughly the same rate, even though they are spoken at widely differing speeds

buff.ly/2m4ou0d

Original Research Article: buff.ly/3V54t7a

#linguistics #language #information #InformationTheory #science #language s

𝗔𝘅𝗶𝗼𝗺𝗮𝘁𝗶𝗰 𝗰𝗵𝗮𝗿𝗮𝗰𝘁𝗲𝗿𝗶𝘇𝗮𝘁𝗶𝗼𝗻𝘀 𝗼𝗳 𝗲𝗻𝘁𝗿𝗼𝗽𝘆: you need only 4 natural axioms to completely characterize the Shannon entropy!
#InformationTheory

Bayangkan kita buang dompet (jgn ada isinya 😜) ke dlm lubang hitam. Kita akan mengira dompet itu hilang selamanya, tp menurut #TeoriInformasi #InformationTheory dompet itu tdk hilang, sebaliknya informasi tersebut disimpan di permukaan 2D lubang hitam..
.

𝗟𝗼𝘀𝘀𝘆 𝘀𝗼𝘂𝗿𝗰𝗲 𝗰𝗼𝗱𝗶𝗻𝗴 as a simple application of the Asymptotic Equipartition Property.
#InformationTheory

So much love for #RandomGraphs and their compression. Is information-theoretic compression gonna give us best results? For now heuristics seem to be doing the job.

Presentation Oriel College during #OrielTalks .
#networkscience #graphtheory #informationTheory #graphCompression

We know we're slacking on our daily AI $XNO image post... Here's one that we thought was really cool!

#XNO #Nano #Feeless #Fast #Nano Network #LowLatency #InformationTheory #GrokChoosesNano #AIImage #DataCentre #Armour Hosting #Armour #Security #WebHosting #VPS #DedicatedHosting

Very simple and useful concept: 𝘁𝗵𝗲 𝘁𝘆𝗽𝗶𝗰𝗮𝗹 𝘀𝗲𝘁 has probability nearly 1, all elements of the typical set are nearly equiprobable, and the number of elements in the typical set is ~ 2^(nH), where H is the entropy and n the length of the sequence.
#InformationTheory

𝗞𝗿𝗮𝗳𝘁'𝘀 𝗜𝗻𝗲𝗾𝘂𝗮𝗹𝗶𝘁𝘆 gives a necessary and sufficient condition for the existence of a prefix code.
𝗠𝗰𝗠𝗶𝗹𝗹𝗮𝗻'𝘀 𝗧𝗵𝗲𝗼𝗿𝗲𝗺 extends the result for uniquely decodable codes.
Kraft's inequality is due to R.M. Redheffer or J.L. Doob!
#InformationTheory

𝗛𝘂𝗳𝗳𝗺𝗮𝗻 𝗰𝗼𝗱𝗶𝗻𝗴 is a variable-length prefix coding algorithm used for lossless data compression, where shorter codes are assigned to more frequent symbols, ensuring optimal compression by minimizing the average code length. Mathematical proof👇
#InformationTheory

Derived one small equation and turned it into a very long paper: 'The Cross-entropy of Piecewise Linear Probability Density Functions' — openreview.net/forum?id=AoOi9… Title is all of the summary you need:-) #informationtheory

If you are at #ICLR , stop by our poster on 'Demystifying Local and Global Fairness Tradeoffs Using Partial Information Decomposition' Poster Session 7, Friday 10:45 AM CEST arxiv.org/pdf/2307.11333… (joint work with Faisal Hamman) #ICLR 2024 #AIEthics #Fairness #informationtheory

Download free 592-page PDF comprehensive eBook on 'Game Theory' here: irving.vassar.edu/faculty/gj/215…
————
#GameTheory #Gamification #Mathematics #Economics #ExperimentalEconomics #Strategy #Auctions #NashEquilibrium #InformationTheory #Statistics #Probability

[Download 592-page PDF eBook] 'Game Theory': irving.vassar.edu/faculty/gj/215…
————
#GameTheory #Gamification #Mathematics #Economics #ExperimentalEconomics #Strategy #Auctions #NashEquilibrium #InformationTheory #Statistics #Probability

I'm at a conference on #informationtheory and the evolution of the genetic code, & most presenters have shown slides w basic definitions obtained from #ChatGPT . Many where very good definitions. Seems #ChatGPT might soon replace the Merriam-Webster for basic definitions...

Check out our latest blog post on practical examples of how AI and Information Theory can be merged:
medium.com/wluper/informa…

#MachineLearning #InformationTheory #ArtificialInteligence

1/2 New! Dynamical Independence: Discovering emergence macroscopic processes in complex dynamical systems. Out today in Physical Review E, led by Lionel Barnett #emergence #informationtheory journals.aps.org/pre/abstract/1… .Erik Hoel .Fernando Rosas .Jessica Flack .Steven Strogatz

These drawings lose their resolution quite quickly. Factors: 1. Paper, 2. Compass Instruments, 3. Pencils. 4 Eyesight --> By the time the message has been passed down 5 times, there are already vast distortions. #pentagram #pythagoraslute #informationtheory

#Deadline approaching for a Postdoctoral Fellowship in the field of Mathematical Statistical #Physics , #InformationTheory , Theoretical #MachineLearning

Apply now! ➡️ ictp.it/opportunity/po…

#workatICTP

What if higher order primates are something invented by mycelial networks to move sentience around?
(As within; So without)

What if lower order information organizations are fractalized matrices of higher order information organizations?
(As above; So below)

#InformationTheory

Assumptions encoded in most IT management methods Vs knowledge era reality
#InformationTheory