Welcome to my personal notes!
https://www.lewissociety.org/innerring/
dwarkesh questions are good
> why is ai progress not slowing down due to lengthening of RL horizons and extra OOMs of compute not being feasible?
> how/when do labs make money? models themselves are profitable but only for a few months, and open source commoditizes everything if there is a slowdown
> what should be done with non profit / charity money created by labs? (OpenAI foundation + Anthropic donations)
> how do countries without labs or exposure to supply chain not fall behind?
for #3, i have some interesting ideas:
for #4, i think you basically just need to align yourself as closely as possible with winning countries. Going long the dollar for example (compute dollar replaces petro dollar etc)
https://caseyhandmer.wordpress.com/2026/05/08/how-to-build-a-lunar-mass-driver/
May 8, 2026
https://simonwillison.net/2026/May/7/xai-anthropic/https://alignment.openai.com/accidental-cot-grading/May 7, 2026
Got Twilio set up for this
https://www.goodfire.ai/research/vpd-explainer#https://www.anthropic.com/research/natural-language-autoencodershttps://www.goodfire.ai/research/the-world-inside-neural-networks#https://static1.squarespace.com/static/54889e73e4b0a2c1f9891289/t/564b6702e4b022509140783b/1447782146111/Sontag-Against+Interpretation.pdfSeptember 3, 2025
https://en.m.wikipedia.org/wiki/The_Myth_of_the_MachineAugust 31, 2025
https://github.com/niespodd/browser-fingerprintinghttps://en.wikipedia.org/wiki/LoglanAugust 27, 2025
https://blog.johnluttig.com/p/indexmindsetAugust 21, 2025
https://sacredseltzer.com/August 16, 2025
https://blog.wilsonl.in/search-engine/June 6, 2025
https://github.com/sindresorhus/cli-spinners?tab=readme-ov-fileMay 10, 2025
https://genai-handbook.github.io/May 4, 2025
https://djr.com/notesMay 2, 2025
https://en.wikipedia.org/wiki/Papal_election_of_Giuseppe_Siri_theoryMay 1, 2025
https://republique.studio/April 23, 2025
https://dynomight.net/aspartame/April 21, 2025
https://tmychow.substack.com/p/pre-training-isnt-dead-its-just-resting?triedRedirect=trueApril 19, 2025
https://en.wikipedia.org/wiki/Nixon_in_Chinagoes insanely hard
April 15, 2025
https://www.tsfreemind.com/April 9, 2025
https://fantasticanachronism.com/about/April 7, 2025
https://joincolossus.com/article/paradigm-shifts-matt-huang/https://www.lesswrong.com/posts/4mvphwx5pdsZLMmpY/recent-ai-model-progress-feels-mostly-like-bullshithttps://web.archive.org/web/20111017155742/http://www.businessweek.com/magazine/the-nixon-shock-08042011.htmlApril 5, 2025
https://www.applieddivinitystudies.com/April 1, 2025
https://www.thefp.com/p/tyler-cowen-why-im-joining-the-freeMarch 31, 2025
https://www.persuasion.community/p/the-average-college-student-is-illiterateok im gonna finish the word embedding / language blog post
March 27, 2025
https://www.anthropic.com/research/tracing-thoughts-language-modelhttps://www.youngmoney.co/March 24, 2025
https://theoverlookedorignored.blogspot.com/https://github.com/gfodor/text2vox
i have still not seen any game that use this kinda stuff?
someone needs to remake scribblenauts
https://www.poetryfoundation.org/poems/45392/ulysseshttps://caseyhandmer.wordpress.com/2024/10/26/we-can-terraform-the-american-west/https://www.therepublicjournal.com/
March 21, 2025
https://www.caseyhandmer.com/March 19, 2025
vespa across america
March 17, 2025
"message to garcia" is goated
https://plato.stanford.edu/entries/strauss-leo/March 16, 2025
https://www.piratewires.com/p/choose-good-questsgonna ask Claude to construct the perfect bracket
March 9, 2025
https://www.rwkv.com/https://literature.bio/March 8, 2025
https://ia601404.us.archive.org/21/items/messagetogarciab00hubb/messagetogarciab00hubb.pdfhttps://minutes.substack.com/p/biotech-for-the-biocuriousMarch 4, 2025
https://djr.com/forma-arabichttps://aidanbench.com/February 28, 2025
https://www.economist.com/1843/2025/02/28/tyler-cowen-the-man-who-wants-to-know-everythingFebruary 23, 2025
https://vietgd.com/February 22, 2025
https://arxiv.org/abs/2502.11264why is there no product that tells me exactly what I should be eating
February 18, 2025
my website is ugly, need to RETVRN to raw html
February 17, 2025
are there any evals of models playing poker?
February 12, 2025
https://harpers.org/archive/2023/02/the-european-way-to-die-euthanasia-assisted-suicide-michel-houellebecq/
fasting today
https://ocw.mit.edu/courses/18-098-street-fighting-mathematics-january-iap-2008/pages/readings/February 11, 2025
https://raypeat.com/articles/aging/aging-estrogen-progesterone.shtmlFebruary 8, 2025
https://www.alignmentforum.org/posts/qGKq4G3HGRcSBc94C/mats-applications-research-directions-i-m-currently-excitedFebruary 7, 2025
https://arxiv.org/abs/2501.18823https://arxiv.org/abs/2406.11944February 6, 2025
https://arxiv.org/abs/2501.12493boutta lock in
https://www.uio.no/studier/emner/hf/iakh/HIS1300MET/v12/undervisningsmateriale/Fussel%20-%20thank%20god%20for%20the%20atom%20bomb.pdf
February 5, 2025
https://marginalrevolution.com/marginalrevolution/2025/02/trumpian-policy-as-cultural-policy.htmlFebruary 3, 2025
https://arxiv.org/abs/2501.19201
February 2, 2025
https://huggingface.co/hexgrad/Kokoro-82MFebruary 1, 2025
https://www.wsj.com/opinion/donald-trump-tariffs-25-percent-mexico-canada-trade-economy-84476fb2https://arxiv.org/abs/2501.16615https://arxiv.org/abs/2501.17727
January 31, 2025
https://colala.berkeley.edu/papers/piantadosi2024why.pdflatent space is the native of language models, and mapping down to english tokens is lossy. the real concepts are stored in the latent representations
reasoning would work better if it could stay in latent space
January 29, 2025
https://www.bloomberg.com/opinion/articles/2025-01-28/housing-crisis-if-wall-street-wants-to-buy-more-homes-let-ithttps://arxiv.org/pdf/2403.00504
https://x.com/qtnx_/status/1884641122447655037
going to find american(chinese) features to steer towards(away)
american version of r1 for those worried about chinese influence, would be pretty funny
can probably finish this today
https://x.com/tylercosg/status/1884747401744855467
LFG
January 27, 2025
https://dominiccummings.substack.com/p/reading-list?r=1g4uc&utm_campaign=post&utm_medium=web&triedRedirect=truehttps://en.wikipedia.org/wiki/Gematria
this is kinda similar to word embeddings
https://www.nytimes.com/2025/01/26/opinion/liberalism-democrats-trump.html
always a bit confused as to what people mean when they say "populism"
like they probably are referring to something like "trumpism", but i can't help thinking that populism is essentially just a synonym for democracy (as is 'politics')
maybe i have been reading too much moldbug
January 26, 2025
https://news.ycombinator.com/item?id=42830646kinda surprising to see such anti-capitalist sentiment be the #1 link on hacker news, given who runs the site
January 21, 2025
https://slatestarcodex.com/2015/04/21/universal-love-said-the-cactus-person/January 20, 2025
https://github.com/deepseek-ai/DeepSeek-R1January 13, 2025
new pg
https://paulgraham.com/woke.htmlJanuary 12, 2025
https://enigmatriz.com/January 7, 2025
https://arxiv.org/abs/2412.19437January 6, 2025
https://www.arxiv.org/abs/2412.10849January 4, 2025
https://4clojure.oxal.org/ai agent pump.fun, revenue distributed according to holder stake
January 3, 2025
https://re-n-y.github.io/devlog/rambling/steering/December 30, 2024
https://d37ugbyn3rpeym.cloudfront.net/stripe-press/TAODSAE_zine_press.pdfDecember 29, 2024
wix/squarespace except it's factorio
December 28, 2024
chat prompt that will write js code that writes a component that is placed directly onto the site
December 24, 2024
https://www.nas.org/academic-questions/31/2/the_case_for_colonialismDecember 16, 2024
need this
https://www.amazon.com/Technological-Republic-Power-Belief-Future/dp/0593798694December 15, 2024
https://www.tilderesearch.com/blog/sieveDecember 14, 2024
https://www.youtube.com/live/4toIHSsZs1cDecember 10, 2024
https://arxiv.org/abs/2412.06769i had a tweet about this same idea
December 7, 2024
https://huggingface.co/nvidia/NV-Embed-v2https://huggingface.co/jxm/cde-small-v1December 3, 2024
https://eryney.substack.com/p/maybe-its-just-your-testosteronehuge news for bros everywhere
https://www.piratewires.com/p/moon-should-be-a-state
similar to what i am writing except this is more focused on the moon itself rather than frontiers in general
December 2, 2024
https://www.map.cv/blog/redbookDecember 1, 2024
think im gonna bring back the storybook AI thing i made last summer but into an app
i just need to build a wrapper
main goal for next ~month or two is to earn a single dollar on some app or website
i have become far too focused on building Something Great that needs venture funding and will have a major impact on the world
truth is that even if i had that idea and the technical skills to do it i probably don't have the right soft skills/intuition yet
overall goal is to become self-sufficient such that i can start to work on the more important things
https://www.wsj.com/business/media/sales-of-bibles-are-booming-fueled-by-first-time-buyers-and-new-versions-d402460e
November 30, 2024
https://marginalrevolution.com/marginalrevolution/2020/01/what-libertarianism-has-become-and-will-become-state-capacity-libertarianism.html
November 29, 2024
https://www.phys.unsw.edu.au/~jw/sailing.htmlwhy is deploying a smart contract on solana so expensive
2.2 SOL??? thats like $500
November 27, 2024
https://osanseviero.github.io/hackerllama/blog/posts/sentence_embeddings/https://www.sciencedirect.com/science/article/pii/S1566253522001233?casa_token=pLpUpqSq8V0AAAAA:s-sYZVH0nggTwt0uGYJOqHNYe1xymiKwfXJp65WhykQz8VzBLXUo1793-ukDogTMOFWPXXMTywNovember 25, 2024
might do something like this on site
https://basement.studio/blog/daylight-shadowshttps://aidanmclaughlin.notion.site/reasoners-problem
November 22, 2024
normal embeddings dont work super well on sentence-length text (if you want to compare meaning, not just sentence structure)
maybe a solution is SAE that is trained on those embeddings, then can filter out unwanted stuff (grammar, etc.)
normal cosine similarity is just too broad, i want to see how similar specific aspects of text is
prediction markets have way less smart money in them, but you could probably use other markets as markers to trade on
every market is a prediction market, the underlying proposition is just sometimes harder to see (obviously not talking about trivial case - predicting this company's sucess)
November 20, 2024
http://kgaddas.free.fr/Finance/CFA/R1%20-%20Overview%20of%20Forward%20Rate%20Analysis.pdfbeing extremely financially literate is probably an underrated skill
https://drive.google.com/drive/mobile/folders/1uYTqpXAagZI3BdP82YsPP6jjogyFjQOk?usp=sharingNovember 19, 2024
https://justinjay.wang/methods-for-random-gradients/need to start ray peat maxxing
November 18, 2024
finally finished Secrets of the Temple (fed policy in the 80s)
took me like a month, was really good though
November 17, 2024
buying factorio was not a good idea
should have waited until winter break
November 16, 2024
gonna write a blog post about buying greenland
maybe i could get it into pirate wires???
you can just do things
November 15, 2024
https://newsletter.maartengrootendorst.com/p/a-visual-guide-to-quantizationNovember 14, 2024
i gotta lock in
November 11, 2024
it's a good day sir
November 7, 2024
https://room.tylercosgrove.com/LGTM
November 5, 2024
https://markets.tylercosgrove.com/
took me long than expected
https://drei.docs.pmnd.rs/abstractions/splat#splat
i really should have built the prediction market builder before the election
that could have gone crazy
November 4, 2024
gonna build this today
https://x.com/dwr/status/1853213820048773140havent done any fun light frontend stuff in a while
November 3, 2024
just bought Huel
will try to eat just that for >a week
nose strips are definitely the move
could be placebo, but i feel way more locked
https://www.eth3d.net/
turns out i should have bought trump NO shares when i said so, market has since moved back to ~50/50
i guess i could have done it with a VPN, but overall probably good i didnt do it since it is illegal
suprising that there are not pure crypto markets, but i guess you do need trusted centralized source who will resolve the market
it would be cool to build a little pump.fun style website for creating predictions markets though
it wouldn't work on a large scale, since market creator has big incentive to just buy one side and then resolve it to that, but it could be fun for small bets among smaller trustworthy groups
why cant you shoot RAW on iphone 11 :(
October 24, 2024
https://github.com/ArthurBrussee/brushOctober 23, 2024
if you know the best way to serve a 100mb file quickly over https tell me
rn i am jusing s3 buckets w/ cloud front, but it still takes ~4 seconds to load :(
October 21, 2024
how does one become a logician
factorio lowkey cbtm
https://www.astralcodexten.com/p/whither-tartaria
October 20, 2024
https://github.com/playcanvas/engineOctober 18, 2024
has anyone done any kind of chain analysis of polymarket whales
there is an interesting dynamic because the market has a definite resolution where if you have YES and market resolves to NO, it makes no difference what you bought YES at since it is worth 0 anyways
so if market seems super inefficient (trump is at 62% all of the sudden) then buying NO for trump in anticipation of the market returning to equilibrium (~50%) maybe doesn’t actually make that much sense
actually idk
seems like market is slowly moving back to 50/50, so buying NO for trump seems like a safe bet until it gets there
i wish you could easily trade in US, i will have to figure out how to do it on the raw contract instead of using the actual polymarket.com
got the gaussian splat of my room working
we have never been more back
October 16, 2024
i have been in cuda hell for the past couple days
i have probably installed and uninstalled every nvidia driver that has been released in the past 3 years
i am doing something wrong
https://github.com/google-research/google-research/tree/master/camp_zipnerfhttps://repo-sam.inria.fr/fungraph/3d-gaussian-splatting/https://gsplat.tech/https://huggingface.co/blog/gaussian-splatting
October 8, 2024
https://github.com/albertgassol1/vf-nerf