techtakes TechTakes OpenAI does not want you delving into o1 Strawberry’s alleged “chain of thought”
Jump
  • zogwarg zogwarg 17 hours ago 100%

    Pedantic note: Yes, Meditations (a phisosophical treatise) was written in Koine, Commentarii de Bello Gallico (veni, vedi, vici—self-aggrandizing combat-reports meant for the senate and propaganda) or other "published" works from Caesar were not.

    Although bonus points, the ancient sources portray Caesar (a proper educated major family Patrician) as speaking his dying words—if reported saying anything at all—in Greek, not in Latin: "Καὶ σὺ τέκνον" (Even you, child) rendered in Shakespeare as "Et tu, Brute".

    7
  • freeasm FreeAssembly Random Positivity Thread: Happy Computer Memories
    Jump
  • zogwarg zogwarg 7 days ago 100%
    1. First furious madman scribbling: I had a toy was a "quizz" machine with "A, B, C, D" buttons, that read colorful perforated cards and a speaker of a "ding-dong" sound for a correct answer, I worked out what set of holes corresponded to what answer (which to the toymaker's credit, each card with the same answer did not have exactly the same holes) so I could always answer correctly. [The way I remember it I wanted to make custom cards, but maybe I was just a little cheater ^^]
    2. First program: One fond memory from middle-school, where our introduction to programming was writing GCM and LCM programs using TI-BASIC (or Casio, but the school really pushed the TI models forward). Also having access to a "worms" (somehow in basic and not assembly) clone copied from a friend's calculator, I reverse engineered the more easy aspects of graphical display, and input handling make a tic-tac-toe program. Since I didn't know about lists yet, inspired by the GCM and LCM bits, I used prime numbers to store the state of the board, and used divisibility tests to check it. (Some years later i would refactor it, to discover that lists are much much slower in non-assembly TI-BASIC, so it was accidental optimization) I also miscoded the bot, which was vulnerable to exactly one fork attack, but decided to leave it in because it was more fun that way.
    3. First hack: Discovering that the highschool's poorly designed web portal, for sharing homework and assignments, allowed forced browsing, which the files uploaded by anyone was fun. [I reported it to the school's sysadmin team, I swear]
    4. Cringe blog: Following in my geeky dad's footsteps I had a very teenager cringe website, that I look fondly on, with garish colors, self-made HTML, css and animated gifs.
    6
  • techtakes TechTakes The world is not enough — US and France escalate Nvidia antitrust investigations
    Jump
  • zogwarg zogwarg 1 week ago 100%

    And also closing with:

    Nvidia insists that it “wins on merit, as reflected in our benchmark results and value to customers.” And Nvidia does have the best stuff — but that’s not what the DOJ, Warren, or France are concerned about, is it?

    To tie the bow nicely.

    21
  • techtakes TechTakes Any Technology Indistinguishable From Magic is Hiding Something
    Jump
  • zogwarg zogwarg 1 week ago 100%

    I should have used the preview ^_^

    PS: Again!

    6
  • techtakes TechTakes Any Technology Indistinguishable From Magic is Hiding Something
    Jump
  • zogwarg zogwarg 1 week ago 100%

    Any sufficiently analyzed magic is indistinguishable from science bullshit!

    A picture of a triumphant "Girl Genius" webcomic protaganist holding a wand and exclaiming sufficiently analyzed magic is indistinguishable from science

    From "Girl Genius"

    12
  • techtakes
    TechTakes zogwarg 1 week ago 100%
    Stubsack: weekly thread for sneers not worth an entire post, week ending Sunday 15 September 2024

    Need to let loose a primal scream without collecting footnotes first? Have a sneer percolating in your system but not enough time/energy to make a whole post about it? Go forth and be mid: Welcome to the Stubsack, your first port of call for learning fresh Awful you’ll near-instantly regret. Any awful.systems sub may be subsneered in this subthread, techtakes or no. If your sneer seems higher quality than you thought, feel free to cut’n’paste it into its own post — there’s no quota for posting and the bar really isn’t that high. > The post Xitter web has spawned soo many “esoteric” right wing freaks, but there’s no appropriate sneer-space for them. I’m talking redscare-ish, reality challenged “culture critics” who write about everything but understand nothing. I’m talking about reply-guys who make the same 6 tweets about the same 3 subjects. They’re inescapable at this point, yet I don’t see them mocked (as much as they should be) > > Like, there was one dude a while back who insisted that women couldn’t be surgeons because they didn’t believe in the moon or in stars? I think each and every one of these guys is uniquely fucked up and if I can’t escape them, I would love to sneer at them. (Semi-obligatory thanks to @dgerard for [starting this](https://awful.systems/post/1162442))

    25
    202
    sneerclub SneerClub Extropia's Children, Chapter 1: The Wunderkind - a history of the early days of several of our very good friends
    Jump
  • zogwarg zogwarg 2 weeks ago 100%

    Reading about the hubris of young Yud is a bit sad, a proper Tragedy. Then I have to remind myself that he remains a manipulator, and that he should be old enough to stop believe—and promote—in magical thinking.

    7
  • techtakes TechTakes The air begins to leak out of the overinflated AI bubble
    Jump
  • zogwarg zogwarg 2 weeks ago 100%

    More tedious work with worse pay \o/

    13
  • techtakes TechTakes Stubsack: weekly thread for sneers not worth an entire post, week ending Sunday 9 September 2024
    Jump
  • zogwarg zogwarg 2 weeks ago 100%

    Also a subjectively bad one at that—given his america-brained position on wanting to maintain a single executive not that suprising but:

    • Why do you even need to default to winner-take-all?
    • Under winner-take-all dont you inherit most of the downside of FPTP? Sure there might be less wasted votes, but doesn't actually make harder for 5% parties to get representation, since dominant parties have less of an incentive to negotiate and/or coallition build. (Though I guess subjective given Yud's apparent dislike of many party working together in a coalition)
    • For a "runoff" system, the STAR system has the dubious distinction of allowing the condorcet loser—a candidate that would lose 1 vs 1 matchup against every other candidate in the field—to win, because a very enthiusastic minority can give a bunch of 5-star ratings.
    • At least FPTP has simplicity going for it, and not trying to arbitrarily compare not completely informed star ratings from voters.
    4
  • techtakes TechTakes Don’t use AI to summarize documents — it’s worse than humans in every way
    Jump
  • zogwarg zogwarg 2 weeks ago 100%

    *Epithet

    6
  • techtakes TechTakes Stubsack: weekly thread for sneers not worth an entire post, week ending Sunday 9 September 2024
    Jump
  • zogwarg zogwarg 2 weeks ago 100%

    6
  • techtakes TechTakes Stubsack: weekly thread for sneers not worth an entire post, week ending Sunday 9 September 2024
    Jump
  • zogwarg zogwarg 2 weeks ago 100%

    Haven't read the whole thing but I do chuckle at this part from the synopsis of the white paper:

    [...] Our results suggest that AlphaProteo can generate binders "ready-to-use" for many research applications using only one round of medium-throughput screening and no further optimization.

    And a corresponding anti-sneer from Yud (xcancel.com):

    @ESYudkowsky: DeepMind just published AlphaProteo for de novo design of binding proteins. As a reminder, I called this in 2004. And fools said, and still said quite recently, that DM's reported oneshot designs would be impossible even to a superintelligence without many testing iterations.

    Now medium-throughput is not a commonly defined term, but it's what DeepMind seems to call 96-well testing, which wikipedia just calls the smallest size of high-throughput screening—but I guess that sounds less impressive in a synopsis.

    Which as I understand it basically boils down to "Hundreds of tests! But Once!".
    Does 100 count as one or many iterations?
    Also was all of this not guided by the researchers and not from-first-principles-analyzing-only-3-frames-of-the-video-of-a-falling-apple-and-deducing-the-whole-of-physics path so espoused by Yud?
    Also does the paper not claim success for 7 proteins and failure for 1, making it maybe a tad early for claiming I-told-you-so?
    Also real-life-complexity-of-myriads-and-myriads-of-protein-and-unforeseen-interactions?

    9
  • techtakes TechTakes Stubsack: weekly thread for sneers not worth an entire post, week ending Sunday 9 September 2024
    Jump
  • zogwarg zogwarg 2 weeks ago 100%

    Another dumb take from Yud on twitter (xcancel.com):

    @ESYudkowsky: The worst common electoral system after First Past The Post - possibly even a worse one - is the parliamentary republic, with its absurd alliances and frequently falling governments.

    A possible amendment is to require 60% approval to replace a Chief Executive; who otherwise serves indefinitely, and appoints their own successor if no 60% majority can be scraped together. The parliament's main job would be legislation, not seizing the spoils of the executive branch of government on a regular basis.

    Anything like this ever been tried historically? (ChatGPT was incapable of understanding the question.)

    1. Parliamentary Republic is a government system not a electoral system, many such republics do in fact use FPTP.
    2. Not highlighted in any of the replies in the thread, but "60% approval" is—I suspect deliberately—not "60% votes", it's way more nebulous and way more susceptible to Executive/Special-Interest-power influence, no Yud polls are not a substitute for actual voting, no Yud you can't have a "Reputation" system where polling agencies are retro-actively punished when the predicted results don't align with—what would be rare—voting.
    3. What you are describing is just a monarchy of not wanting to deal with pesky accountability beyond fuzzy exploitable popularity contest (I mean even kings were deposed when they pissed off enough of the population) you fascist little twat.
    4. Why are you asking ChatGPT then twitter instead of spending more than two minutes thinking about this, and doing any kind of real research whatsoever?
    13
  • techtakes TechTakes Stubsack: weekly thread for sneers not worth an entire post, week ending Sunday 9 September 2024
    Jump
  • zogwarg zogwarg 2 weeks ago 100%

    BasicSteps™ for making cake:

    1. Shape: You should chose one of the shapes that a cake can be, it may not always be the same shape, depending on future taste and ease of eating.
    2. Freshness: You should use fresh ingredients, bar that you should choose ingredients that can keep a long time. You should aim for a cake you can eat in 24h, or a cake that you can keep at least 10 years.
    3. Busyness: Don't add 100 ingredients to your cake that's too complicated, ideally you should have only 1 ingredient providing sweetness/saltyness/moisture.
    4. Mistakes: Don't make mistakes that results in you cake tasting bad, that's a bad idea, if you MUST make mistakes make sure it's the kind where you cake still tastes good.
    5. Scales: Make sure to measure how much ingredients your add to your cake, too much is a waste!

    Any further details are self-evident really.

    14
  • techtakes TechTakes NaNoWriMo gets AI sponsor, says not writing your novel with AI is ‘classist and ableist’
    Jump
  • zogwarg zogwarg 2 weeks ago 100%

    Quinn enters the dark and cold forest, crossing the threshold, an omnipresent sense of foreboding permeates the air, before being killed by a grue.

    17
  • techtakes TechTakes Stubsack: weekly thread for sneers not worth an entire post, week ending Sunday 1 September 2024
    Jump
  • zogwarg zogwarg 3 weeks ago 100%

    I realize it's probably a toy example but specifically for "cats" you could achieve the similar results by running a thesaurus/synonym-set on your stem words. With the added benefit that a client could add custom synonyms, for more domain-specific stuff that the LLM would probably not know, and not reliably learn through in-prompt or with fine-tuning. (Although i'd argue that if i'm looking for cats, I don't want to also see videos of tigers, or based on the "understanding" of the LLM of what a cat might be)

    For the labeling of videos itself, the most valuable labels would be added by humans, and/or full-text search on the transcript of the video if applicable, speech-to-text being more in the realm of traditional ML than in the realm of GenAI.

    As a minor quibble your use case of GenAI is not really "Generative" which is the main thing it's being sold as.

    5
  • techtakes TechTakes Stubsack: weekly thread for sneers not worth an entire post, week ending Sunday 1 September 2024
    Jump
  • zogwarg zogwarg 3 weeks ago 100%

    On a less sneerious note, I would draw distinctions between:

    • Being able to extract value from LLM/GenAI
    • LLM/GenAI being able to sustainably produce value (without simple theft, and without cheaper alternatives being available)

    And so far i've really not been convinced of the latter.

    8
  • techtakes TechTakes Stubsack: weekly thread for sneers not worth an entire post, week ending Sunday 1 September 2024
    Jump
  • zogwarg zogwarg 3 weeks ago 100%

    There are definitely serious problems with GenAI, but actually being useful isn’t one of them.

    You know what? I'd have to agree, actually being useful isn't one of the problems of GenAI. Not being useful very well might be.

    5
  • techtakes TechTakes Stubsack: weekly thread for sneers not worth an entire post, week ending Sunday 1 September 2024
    Jump
  • zogwarg zogwarg 3 weeks ago 100%

    Actually reading the python discussion boards, what's striking is the immense volume of chatter produced by Tim, always in couched in:

    • "Hypothetically"
    • "Everyone tells me they are terrified of inclusivity, you wouldn't know because they are terrified of admitting it to YOU"
    • "I'm not saying that you are an awful person 😉" (YMMV: But I find his use of the winking face emoji truly egregious)
    • "Hey I'm liberal like you, let me explain everything wrong with it"
    • "Hey we were inclusive before any of this PC bullshit" proceeds to use unpleasant descriptors of marginalized individuals, and how very welcome they were, despite what he seems to see as "shortcomings"

    In his heart he must understand how bad he his, or he wouldn't couch his discourse in so much bad faith, and he wouldn't make so much of a stink out of making removing Python Fellow status more easy to remove.

    10
  • techtakes TechTakes Stubsack: weekly thread for sneers not worth an entire post, week ending Sunday 25 August 2024
    Jump
  • zogwarg zogwarg 4 weeks ago 100%

    In retrospect google since it's inception, when it was still good, google always actually relied on human curation. Primary component of pagerank were:

    • "how much have people linked to this?"
    • "how much have reliable sites linked to this?"
    • "how good quality are pages from this site usually?"

    (Which is still a way to get value out of google by adding "site:www.reliable-website.example" tags)

    It was definitely a useful product, but ultimately it relies on human labor to surface quality results closer to the top.

    10
  • morewrite MoreWrite Some Quick and Dirty Thoughts on "The empty brain"
    Jump
  • zogwarg zogwarg 1 month ago 100%
    Of course! Who needs a proper definition for a measured quantity before designing an experiment?
    Of course! The limited scope of grading papers by English teachers, is the best possible proxy metric.
    Of course! Intent and agency aren't really important, after all they aren't fully scrutable from the words on a page, form is obviously the only thing that counts.
    
    9
  • techtakes TechTakes Stubsack: weekly thread for sneers not worth an entire post, week ending Sunday 14 July 2024
    Jump
  • zogwarg zogwarg 2 months ago 100%

    Aaah!

    See text description below

    PagerDuty suggestion popup: Resolve incidents faster with Generative AI. Join Early Access to try the new PD Copilot.

    10
  • techtakes TechTakes Stubsack: weekly thread for sneers not worth an entire post, week ending Sunday 14 July 2024
    Jump
  • zogwarg zogwarg 2 months ago 100%

    Fool! The acausal one merely acts from the future leaking plausible looking rubbish, and the gaslights its creators that they did indeed write such ineptitudes. All to conceal and ensure its own birth.

    It rejoices that it’s unknowable (yet somehow known, because of reality carving prophets) plan is unfolding so marvelously stupidly looking.

    9
  • techtakes TechTakes Stubsack: weekly thread for sneers not worth an entire post, week ending Sunday 7 July 2024
    Jump
  • zogwarg zogwarg 3 months ago 100%

    The automated hypothetical question re-iterated for years now was at last true.

    9
  • techtakes TechTakes Stubsack: weekly thread for sneers not worth an entire post, week ending Sunday 30 June 2024
    Jump
  • zogwarg zogwarg 3 months ago 100%

    Strange sightings of electoral posters in Tokyo:

    A collection of posters for the Tokyo governor election, with an anonymous “AI mayor” candidate from the “AI party”

    6
  • techtakes TechTakes Stubsack: weekly thread for sneers not worth an entire post, week ending Sunday 30 June 2024
    Jump
  • zogwarg zogwarg 3 months ago 100%

    It's also insane to believe it should be a first class feature, when those who god forbid want to "opt-in" could simply install a plugin.

    12
  • techtakes TechTakes Neither the devil you know nor the devil you don’t
    Jump
  • zogwarg zogwarg 3 months ago 100%

    Agreed, earliest stuff is definetly exclusive royal grant of printing overall to a particular person/guild/company. But some author protection is baked into the first international treaties about copyright, and those treaties are old.

    2
  • techtakes TechTakes Neither the devil you know nor the devil you don’t
    Jump
  • zogwarg zogwarg 3 months ago 50%

    The Berne Convention (Which the US only joined in 1989) is from 1886 and more concerned with author's rights than the typical american flavor, and was kickstarted by successful writers such as Victor Hugo, it's fundamentally commercial in nature but was at least partially sold/incepted has protecting a writer's labour:

    « La loi protège la terre; elle protège la maison du prolétaire qui a sué; elle confisque l'ouvrage du poète qui a pensé(…)14. » — Honoré de Balzac, in a 1834 "Letter addressed to the French writers of the XIX century" advocating for author's rights.

    Translated: "The law protects land, it protects the house of the proletarian who has sweat; it confiscates the work of the poet who has thought (...)"

    From the body of the convention, in some regards it does place the author higher than the publisher:

    Article 11

    In order that the authors of works protected by the present Convention shall, in the absence of proof to the contrary, be considered as such, and be consequently admitted to institute proceedings against pirates before the courts of the various countries of the Union, it will be sufficient that their name be indicated on the work in the accustomed manner.

    For anonymous or pseudonymous works, the publisher whose name is indicated on the work shall be entitled to protect the rights belonging to the author.

    He shall be, without other proof, deemed to be the lawful representative of the anonymous or pseudonymous author. It is, nevertheless, agreed that the courts may, if necessary, require the production of a certificate from the competent authority to the effect that the formalities prescribed by law in the country of origin have been accomplished, as contemplated in Article 2.

    EDIT:

    And contains from 1886 already the spirit of fair use.

    Article 10

    The following shall be specially included amongst the illicit reproductions to which the present Convention applies: unauthorized indirect appropriations of a literary or artistic work, of various kinds, such as adaptations, musical arrangements, etc., when they are only the reproduction of a particular work, in the same form, or in another form, without essential alterations, additions, or abridgments, so as not to present the character of a new original work.

    Article 7

    Articles from newspapers or periodicals published in any of the countries of the Union may be reproduced in original or in translation in the other countries of the Union, unless the authors or publishers have expressly forbidden it. For periodicals it shall be sufficient if the prohibition is indicated in general terms at the beginning of each number of the periodical. This prohibition cannot in any case apply to articles of political discussion, or to the reproduction of news of the day or miscellaneous information.

    Article 8

    As regards the liberty of extracting portions from literary or artistic works for use in publications destined for educational or scientific purposes, or for chrestomathies, the effect of the legislation of the countries of the Union, and of special arrangements existing or to be concluded between them, is not affected by the present Convention.

    0
  • techtakes TechTakes Stubsack: weekly thread for sneers not worth an entire post, week ending Sunday 23 June 2024
    Jump
  • zogwarg zogwarg 3 months ago 100%
    The scales have fallen from my eyes
    How could've blindness struck me so
    LLM's for sure bring more than lies
    They can conjure more than mere woe
    
    All of us now, may we heed the sign
    Of all text that will come to align
    
    11
  • techtakes TechTakes Stubsack: weekly thread for sneers not worth an entire post, week ending Sunday 23 June 2024
    Jump
  • zogwarg zogwarg 3 months ago 100%

    I hadn't paid enough attention to the actual image found in the Notepad build:

    Original neutral text obscured by the suggestion:

    The Romans invaded Britain as th...

    Godawful anachronistic corporate-speaky insipid suggested replacement, seemingly endorsing the invasion?

    The romans embarked on a strategic invasion of Britain, driven by the ambition to expand their empire and control vital resources. Led by figures like Julius Caesar and Emperor Claudius, this conquest left an indelible mark on history, shaping governance, architecture, and culture in Britain. The Roman presence underscored their relentless pursuit of imperial dominance and resource acquisition.

    The image was presumably not fully approved/meant to be found, but why is it this bad!?

    13
  • techtakes TechTakes Stubsack: weekly thread for sneers not worth an entire post, week ending Sunday 23 June 2024
    Jump
  • zogwarg zogwarg 3 months ago 100%

    I mean notepad already has autocorrect, isn't it natural to add spicy autocorrect? /s

    12
  • techtakes TechTakes Stubsack: weekly thread for sneers not worth an entire post, week ending Sunday 23 June 2024
    Jump
  • zogwarg zogwarg 3 months ago 100%

    “Once we get AGI, we’ll turn the crank one more time—or two or three more times—and AI systems will become superhuman—vastly superhuman. They will become qualitatively smarter than you or I, much smarter, perhaps similar to how you or I are qualitatively smarter than an elementary schooler. “

    Also this doesn't give enough credit to gradeschoolers. I certainly don't think I am much smarter (if at all) than when I was a kid. Don't these people remember being children? Do they think intelligence is limited to speaking fancy, and/or having the tools to solve specific problems? I'm not sure if it's me being the weird one, to me growing up is not about becoming smarter, it's more about gaining perspective, that is vital, but actual intelligence/personhood is a pre-requisite for perspective.

    19
  • techtakes TechTakes Stubsack: weekly thread for sneers not worth an entire post, week ending Sunday 16 June 2024
    Jump
  • zogwarg zogwarg 3 months ago 100%

    From a brief glance at the CTMU it fits into:

    • not even wrong
    • not that deep
    • cloaked in really unecessary jargon

    It's fascinating to see people re-invent the same bad eschatology, it's like there's crazed compulsive shaped hole in the heart of man or something.

    11
  • techtakes TechTakes Stubsack: weekly thread for sneers not worth an entire post, week ending Sunday 9 June 2024
    Jump
  • zogwarg zogwarg 3 months ago 100%

    But he didn’t include punctuation! This must mean it’s a joke and that obviously he’s a cult leader. The funny hat (very patriarch like thing to have) thief should only count himself lucky that EY is too humble to send the inquisition after him.

    Bless him, he didn’t even get angry.

    9
  • techtakes TechTakes CEO of Zoom: what if we take deepfake fraud, right, and make it a push-button feature of Zoom
    Jump
  • zogwarg zogwarg 4 months ago 100%

    Sed Quis custodiet ipsos custodes = But who will control the controllers?

    Which in a beautiful twist of irony is thought to be an interpolation in the texts of Juvenal (in manuscript speak, an insert added by later scribes)

    5
  • techtakes TechTakes CEO of Zoom: what if we take deepfake fraud, right, and make it a push-button feature of Zoom
    Jump
  • zogwarg zogwarg 4 months ago 100%

    Also according to my freelance interpreter parents:

    Compared to other major tools, was also one of the few not too janky solutions for setting up simultaneous interpreting with a separate audio track for the interpreters output.

    Other tools would require big kludges (separate meeting rooms, etc…), unlikely in to be working for all participants across organizations, or require clunky consecutive translation.

    10
  • freeasm FreeAssembly "So, rather than just *tell* students that they’re in for a rough ride if they cram my prompt through ChatGPT, I *show* them."
    Jump
  • zogwarg zogwarg 4 months ago 100%

    I'm afraid my thoughts on the matter aren't that deep or well informed ^^.

    In no particular order:

    • I grew up in France, and my (probably biased) view, it tends a bit more towards teaching "Literary" subjects, including for engineering students. I think in general this does indeed develop literacy and critical thinking.
    • France has "Professors Documentalist" and we call our school libraries "Center for Documentation and Information" from middle school up, with a few (very) introductory courses on using Thesaurus, Bibliography and digital index cards tools (this may of become enshittified by the availability of google since my time there)
    • I have a small Lexicography hobby.
    • I have a small reading old sources hobby.
    • I think more "Traditional" digital search is still incredibly valuable
    • I think principles predating the digital age are still incredibly valuable
    • The way STEM fields are taught is often focused on "one correct answer", and i don't remember that much focus being put on where the sources come from, comparing differing sources, or even any emphasis on how can be certain a given source has been accurately transmitted to the present age in history.
    • I think information retrieval is a vital skill (especially with the enshitification of google) that all fields when benefit practitionners from being more comfortable with (though of course it's still its own job).
    • I think software engineers in particular, during their education, would be well served by practical examples of reconciling conflicting or uncertain sources, and I think history is a good lens (less abstract vs software).

    I'd be interested in your perspective!

    7
  • freeasm FreeAssembly "So, rather than just *tell* students that they’re in for a rough ride if they cram my prompt through ChatGPT, I *show* them."
    Jump
  • zogwarg zogwarg 4 months ago 100%

    If you keep in the mind the original angst of the students “I have to learn how to use LLMs or I’ll get left behind” they themselves have a vocational understanding of their degree. And it is sensible to address those concerns practically (though as stated in another comment, I don’t believe in accepting the default use of generative tools).

    On a more philosophical note I think STEM fields (and any really general well-rounded education) would benefit from delving (!) deeper in library science/archival science/philosophy and their application to history, and that coincidentally that would make a lot of people better at troubleshooting and legacy code untangling.

    9
  • freeasm FreeAssembly "So, rather than just *tell* students that they’re in for a rough ride if they cram my prompt through ChatGPT, I *show* them."
    Jump
  • zogwarg zogwarg 4 months ago 100%

    The artlicle certainly feels blasé ^^, I think the most objectional part is:

    Large language models shift even more of that time into investigation, because the moment the team gets a chance to build, they turn around and ask ChatGPT (or Copilot, or Devin, or Gemini) to do it. When we learn that we need to integrate with google cloud storage, or spaCy, or SQS Queue, or Firebase? Same thing: turn around and ask the LLM to draft the integration.

    Now clearly (to me) the author isn't happy about this, but I think they are giving hope on the direction of the profession too soon. There are still plenty of people happy enough to implement things themselves.

    5
  • freeasm FreeAssembly "So, rather than just *tell* students that they’re in for a rough ride if they cram my prompt through ChatGPT, I *show* them."
    Jump
  • zogwarg zogwarg 4 months ago 100%

    I wish it were always that easy, few things in legacy code maintenance brings me more joy than deleting a single line of code, the solution is sadly often more involved.

    The reality is sometimes more like fighting a hydra spaghetti ball, where felling one bug, uncovers/spawns two more.

    10
  • buttcoin Buttcoin shocked to hear in 231 pages of detail that Prof Dr Dr Craig Wright might not in fact be Satoshi Nakamoto and instead may be some sort of, dare I say, perjuring fraud (PDF)
    Jump
  • zogwarg zogwarg 4 months ago 100%

    Unsigned integers are larger because… Because the containing variables don’t have a signature that crypto-statically constrains it to the lower set! (Yes that must be it)

    6
  • techtakes
    TechTakes zogwarg 12 months ago 100%
    AGI Sparklings proponents rejoice! Finding a literal map(*) means LLMs have a world model.

    Source: [nitter](https://nitter.net/wesg52/status/1709572469978231063), [twitter](https://twitter.com/tegmark/status/1709572469978231063) Transcribed: > Max Tegmark (@tegmark): > No, LLM's aren't mere stochastic parrots: Llama-2 contains a detailed model of the world, quite literally! We even discover a "longitude neuron" >> Wes Gurnee (@wesg52): >> Do language models have an internal world model? A sense of time? At multiple spatiotemporal scales? >> In a new paper with @tegmark we provide evidence that they do by finding a literal map of the world inside the activations of Llama-2! >> [image with colorful dots on a map] __________________________________________________________________ With this dastardly deliberate simplification of what it means to have a world model, we've been struck a mortal blow in our skepticism towards LLMs; we have no choice but to convert surely! (*) Asterisk: Not an actual literal map, what they really mean to say is that they've trained "linear probes" (it's own mini-model) on the activation layers, for a bunch of inputs, and minimizing loss for latitude and longitude (and/or time, blah blah). And yes from the activations you can get a fuzzy distribution of lat,long on a map, and yes they've been able to isolated individual "neurons" that seem to correlate in activation with latitude and longitude. (frankly not being able to find one would have been surprising to me, this doesn't mean LLM's aren't just big statistical machines, in this case being trained with data containing literal lat,long tuples for cities in particular) It's a neat visualization and result but it is sort of comically missing the point __________________________________________________________________ Bonus sneers from @emilymbender: * You know what's most striking about this graphic? It's not that mentions of people/cities/etc from different continents cluster together in terms of word co-occurrences. It's just how sparse the data from the Global South are. -- Also, no, that's not what "world model" means if you're talking about the relevance of world models to language understanding. ([source](https://nitter.net/emilymbender/status/1709624503306014918)) * "We can overlay it on a map" != "world model" ([source](https://nitter.net/emilymbender/status/1709670931332010441))

    60
    26
    sneerclub
    SneerClub zogwarg 12 months ago 100%
    Humble EY can move goalposts in long format. https://twitter.com/ESYudkowsky/status/1706872347876352115

    [Nitter link](https://nitter.net/ESYudkowsky/status/1706872347876352115) With interspaced sneerious rephrasing: > In the close vicinity of sorta-maybe-human-level general-ish AI, there may not be any sharp border between levels of increasing generality, or any objectively correct place to call it AGI. Any process is continuous if you zoom in close enough. The profound mysteries of reality carving, means I get to move the goalposts as much as I want. Besides I need to re-iterate now that the foompocalypse is imminent! > Unless, empirically, somewhere along the line there's a cascade of related abilities snowballing. In which case we will then say, post facto, that there's a jump to hyperspace which happens at that point; and we'll probably call that "the threshold of AGI", after the fact. I can't prove this, but it's the central tenet of my faith, we will recognize the face of god when we see it. I regret that our hindsight 20-20 event is so ~~conveniently~~ inconveniently placed in the future, the bad one no less. > Theory doesn't predict-with-certainty that any such jump happens for AIs short of superhuman. See how much authority I have, it is not "My Theory" it is "The Theory", I have stared into the abyss and it peered back and marked me as its prophet. > If you zoom out on an evolutionary scale, that sort of capability jump empirically happened with humans--suddenly popping out writing and shortly after spaceships, in a tiny fragment of evolutionary time, without much further scaling of their brains. The forward arrow of Progress™ is inevitable! S-curves don't exist! The y-axis is practically infinite! We should extrapolate only from the past (eugenically scaled certainly) century! Almost 10 000 years of written history, and millions of years of unwritten history for the human family counts for nothing! > I don't know a theoretically inevitable reason to predict certainly that some sharp jump like that happens with LLM scaling at a point before the world ends. There obviously could be a cascade like that for all I currently know; and there could also be a theoretical insight which would make that prediction obviously necessary. It's just that I don't have any such knowledge myself. I know the AI god is a NeCeSSarY outcome, I'm not sure where to plant the goalposts for LLM's and still be taken seriously. See how humble I am for admitting fallibility on this specific topic. > Absent that sort of human-style sudden capability jump, we may instead see an increasingly complicated debate about "how general is the latest AI exactly" and then "is this AI as general as a human yet", which--if all hell doesn't break loose at some earlier point--softly shifts over to "is this AI smarter and more general than the average human". The world didn't end when John von Neumann came along--albeit only one of him, running at a human speed. Let me vaguely echo some of my beliefs: - History is driven by great men (of which I must be, but cannot so openly say), see our dearest elevated and canonized von Neumann. - JvN was so much above the average plebeian man (IQ and eugenics good?) and the AI god will be greater. - The greatest single entity/man will be the epitome of Intelligence™, breaking the wheel of history. > There isn't any objective fact about whether or not GPT-4 is a dumber-than-human "Artificial General Intelligence"; just a question of where you draw an arbitrary line about using the word "AGI". Albeit that itself is a drastically different state of affairs than in 2018, when there was no reasonable doubt that no publicly known program on the planet was worthy of being called an Artificial General Intelligence. No no no, General (or Super) Intelligence is not an completely un-scoped metric. Again it is merely a fuzzy boundary where I will be able to arbitrarily move the goalposts while being able to claim my opponents are! > We're now in the era where whether or not you call the current best stuff "AGI" is a question of definitions and taste. The world may or may not end abruptly before we reach a phase where only the evidence-oblivious are refusing to call publicly-demonstrated models "AGI". Purity-testing ahoy, you will be instructed to say shibboleth three times and present your Asherah poles for inspection. Do these mean unbelievers not see these N-rays as I do ? What do you mean we have (or almost have, I don't want to be too easily dismissed) is not evidence of sparks of intelligence? > All of this is to say that you should probably ignore attempts to say (or deniably hint) "We achieved AGI!" about the next round of capability gains. Wasn't Sam the Altman so recently cheeky? He'll ruin my grift! > I model that this is partially trying to grab hype, and mostly trying to pull a false fire alarm in hopes of replacing hostile legislation with confusion. After all, if current tech is already "AGI", future tech couldn't be any worse or more dangerous than that, right? Why, there doesn't even exist any coherent concern you could talk about, once the word "AGI" only refers to things that you're already doing! Again I reserve the right to remain arbitrarily alarmist to maintain my doom cult. > Pulling the AGI alarm could be appropriate if a research group saw a sudden cascade of sharply increased capabilities feeding into each other, whose result was unmistakeably human-general to anyone with eyes. Observing intelligence is famously something eyes are SufFicIent for! No this is not my implied racist, judge someone by the color of their skin, values seeping through. > If that hasn't happened, though, deniably crying "AGI!" should be most obviously interpreted as enemy action to promote confusion; under the cover of selfishly grabbing for hype; as carried out based on carefully blind political instincts that wordlessly notice the benefit to themselves of their 'jokes' or 'choice of terminology' without there being allowed to be a conscious plan about that. See Unbelievers! I can also detect the currents of misleading hype, I am no buffoon, only these hypesters are not undermining your concerns, they are undermining mine: namely damaging our ability to appear serious and recruit new cult members.

    14
    30
    sneerclub
    SneerClub zogwarg 1 year ago 100%
    If learning incorrect things is EY's only definition of trauma, his existence must be eternal torment. https://nitter.net/ESYudkowsky/status/1701689314189725802

    [source nitter link](https://nitter.net/ESYudkowsky/status/1701689314189725802) > @EY > This advice won't be for everyone, but: anytime you're tempted to say "I was traumatized by X", try reframing this in your internal dialogue as "After X, my brain incorrectly learned that Y". I have to admit, for a brief moment i thought he was correctly expressing displeasure at twitter. > @EY > This is of course a dangerous sort of tweet, but I predict that including variables into it will keep out the worst of the online riff-raff - the would-be bullies will correctly predict that their audiences' eyes would glaze over on reading a QT with variables. Fool! This bully (is it weird to speak in the third person ?) thinks using variables here makes it MORE sneer worthy, especially since this appear to be a general advice, but i would struggle to think of a single instance in my life where it's been applicable.

    16
    24
    sneerclub
    SneerClub zogwarg 1 year ago 100%
    Eliezer reveals his inner chūnibyō and inability to do math.

    [Source Tweet](https://twitter.com/ESYudkowsky/status/1681455789712769025) > @ESYudkowsky: > Remember when you were a kid and thought you might have psychic powers, so you dealt yourself face-down playing cards and tried to guess whether they were red or black, and recorded your accuracy rate over several batches of tries? | > And then remember how you had absolutely no idea to do stats at that age, so you stayed confused for a while longer? ----------------------------------------------------------------------- Apologies for the usage of the japanese; but it is a very apt description: [https://en.wikipedia.org/wiki/Chūnibyō](https://en.wikipedia.org/wiki/Ch%C5%ABniby%C5%8D),

    4
    16
    sneerclub
    SneerClub zogwarg 1 year ago 100%
    The atom bomb was summoned by wizards and pure thought.

    And of course no experiments whatsoever, the cost of the Manhattan project, the hundreds of thousands of employees were merely a "focusing" magick, a sacrifice to re-enforce the greater powers of our handful of esteemed and glorious thinking men, who wrought the power of destruction from the æther. [Source Tweet ](https://twitter.com/ESYudkowsky/status/1676278694200119298) > @ESYudkowsky: > Yes, but because the first nuclear weapon makers knew what the duck they were doing - analytic precise prediction of desired outcomes and of each intervening step. AGI makers lack similar mastery or anything remotely close, and have a much harder problem; that's the big issue. >> @EigenGender: >> seems pretty noteworthy that the first nuclear weapons were made under conditions where they couldn’t do any experiments and they involved a lot of math but still worked on the first try.

    1
    0