german The German Language Hallo alle, ich bin neu hier.
Jump
forumlibre Forum Libre Que serait une recompense juste pour un parent à domicile?
Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearAK
    Akisamb
    3 weeks ago 100%

    Tu as des subsides pour la LAMAL. Pour vivre à 1300 tu es obligé de les utiliser.

    Je confirme 1300 c'est obligatoirement une colocation ou en couple et tu ne vas jamais au restaurant.

    Mais à 4000 tu n'as plus toutes ces contraintes. Quand j'ai touché 3600 CHF pour la première fois j'avais vraiment l'impression d'être riche. Je pouvais aller au restaurant tous les jours, partir à l'autre bout de l'Europe sur un coup de tête etc...

    1
  • forumlibre Forum Libre Que serait une recompense juste pour un parent à domicile?
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearAK
    Akisamb
    3 weeks ago 100%

    4000 balles et c’est la galère avec ça

    Faut pas abuser, j'ai vécu il y a 3 ans avec 1300 balles par mois à Lausanne et c'était pas si juste que ça.

    4000 tu as une assez bonne qualité de vie.

    J'ajouterai que ça dépend des cantons, je connais des gens dans le Valais qui ne gagnent que 2800 CHF par mois en travaillant a plein temps (41h semaine).

    1
  • europe Europe German stabbing suspect is 26-year-old Syrian man who admitted to the crime
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearAK
    Akisamb
    4 weeks ago 100%

    Thank you, handling these subjects is already annoying at family dinners. I can't imagine handling this on an online forum.

    3
  • france France A Marseille, la misère des petites mains du trafic de drogue : « Ils ne me donnaient même pas d’argent »
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearAK
    Akisamb
    1 month ago 100%

    Tu trouves la forme d'exploitation faite par une entreprise aussi mauvaise que celle faite par ces trafiquants de drogues?

    8
  • techtakes TechTakes Elon Musk releases Grok-2 AI image generator for edgelords
    Jump
    privacy Privacy Mozilla wants you to love Firefox again
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearAK
    Akisamb
    1 month ago 100%

    They've got thunderbird which is as far as I know the only serious alternative to outlook.

    11
  • france France Budget macroniste : 1,6 milliard en moins pour l'enseignement, 1,4 milliard jeté dans la Seine - Contre Attaque
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearAK
    Akisamb
    3 months ago 100%

    Pas forcément d'accord pour les 1,4 milliards pour la Seine. A ma connaissance il n'y a pas eu de mesures d'urgence et temporaires. Toute l'infrastructure va rester en place.

    Après c'est vrai que ça coûte 140 euros par habitant d'Ile de France, ce qui n'est pas négligeable. Mais de la a appeler ça un caprice.

    2
  • france France La France baisse de 5,3 % ses émissions de gaz à effet de serre au premier trimestre
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearAK
    Akisamb
    3 months ago 100%

    Ton article parle d'autre chose. Il parle de l'année 2023 par rapport à l'année 2022. La on compare le premier semestre 2024 au premier semestre 2023.

    J'ai répondu par rapport au secteur de l'industrie dans un autre commentaire, pour ce secteur là ça semble être une bonne chose. Pour les autres secteurs en forte baisse, je n'ai pas fait d'analyse, mais il n'y a pas de raison que cette baisse soit liée à des choses négatives. Par exemple une grosse partie des réductions sont dues à un hiver clément.

    Le seul point noir, c'est les transports. On sait très bien comment réduire les émissions, vu que la demande est élastique par rapport au prix. Mais plus personne n'osera mettre en place une taxe CO2 (merci les gilets jaunes). Le RN promet même de retirer les taxes sur l'essence (quitte même à ne pas respecter les règles de l'UE), histoire qu'on soit encore plus dépendant des dictatures.

    4
  • france France La France baisse de 5,3 % ses émissions de gaz à effet de serre au premier trimestre
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearAK
    Akisamb
    3 months ago 100%

    Peut-être pour la baisse de 5% des émissions de l'industrie. Mais pas pour les autres secteurs.

    C'est aussi possible qu'il n'y ait pas eu de baisse dans l'industrie. Ton article parle de faillite d'entreprises, ce qui ne veut pas dire une cessation d'activité économique, juste que le propriétaire a perdu son argent.

    Le premier exemple de ton article, je la connais bien. C'est Ascometal, j'ai suivi la saga avec Marsactu. L'usine continuera de produire après sa reprise avec juste l'arrêt de l'activité du fil. L'entreprise racheteuse va aussi investir pour ajouter un four électrique pour réduire l'impact carbone de l'entreprise.

    Ce qu'il faudrait regarder c'est la production industriel, qui est assez stable :

    La production du premier trimestre 2024 est légèrement supérieure à celle du premier trimestre 2023 dans l’industrie manufacturière (+0,4 %) comme dans l’ensemble de l’industrie (+0,3 %).

    4
  • france France Bardella est pour la retraite à 66 ans 😬 (Même Macron n'a pas osé 😂)
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearAK
    Akisamb
    3 months ago 100%

    Sauf que les gens qui ne font pas d'études ont une espérance de vie plus faible. C'est normal qu'il puissent prendre leur retraite plus tôt.

    C'est ce qui me gênait le plus dans la réforme de Macron. L'augmentation de l'âge minimum pour la retraite touche plus les précaires qu'une augmentation des années de cotisations.

    En tant qu'ingénieur, j'ai un travail bien moins pénible qu'un ouvrier, c'est normal que je prenne une retraite plus tardive.

    5
  • europe Europe New German citizens required to affirm Israel's right to exist
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearAK
    Akisamb
    3 months ago 100%

    including the Slogan: 'From the river to the sea – Palestine shall be free'

    As it should, this phrase and it's Israeli counterpart "between the sea and the Jordan there will be only Israeli sovereignty" are often accompanied by calls for mass deportation at best and genocide at worst.

    These sentences are not bad on their own, but the parties from which they originate (Hamas and Likud) have transparent desires for war crimes and genocide.

    7
  • europe Europe "Unacceptable" Poland Demands Answers After Germany Dumpsters Afghan Migrants At Polish Border - News18
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearAK
    Akisamb
    3 months ago 100%

    https://notesfrompoland.com/2024/06/17/poland-demands-explanation-after-german-police-transport-migrant-family-back-over-border/

    “They had Polish refugee status certificates for the adults and Polish ID cards for the children. These people were taken to the police station for further investigation,” said von Vegesack. He added that, after their legal situation was confirmed, the family had to be sent back to Poland.

    According to the spokesman, German officials informed the Polish border guard about the situation through the Polish-German Centre for Cooperation of Border, Police and Customs Services in Świecko.

    “Since there was no reaction from the Polish side for several hours, the officers decided to take the family to the Polish-German border…in order to release them to Poland,” said von Vegesack.

    The article above should be more "polish refugees left alone in Poland by German police" rather than the current one which suggests that Germany is getting rid of its migrants illegally.

    19
  • france France Jérôme Peyrat
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearAK
    Akisamb
    3 months ago 100%

    Depuis janvier 2021, il est conseiller politique auprès de la délégation générale de La République en marche. Jérôme Peyrat est condamné en 2020 pour violences conjugales sur son ancienne compagne, ce qui le conduit à renoncer à sa candidature aux élections législatives de 2022.

    Il finit par se représenter aux élections législatives anticipées de 2024 malgré les polémiques que sa candidature lève

    Le petit filou, il a attendu qu'on l'oublie. Je ne comprends pas pourquoi les partis politiques tiennent autant à garder ces éléments.

    7
  • machine_learning Machine Learning LGGMs a new class of graph generative models trained on a large corpus of graphs
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearAK
    Akisamb
    3 months ago 100%

    Huh, your comment made look if there were personalized recommendation algorithms running on lemmy. From what I found, it appears that Lemmy does not use personalized recommendation algorithms : https://join-lemmy.org/docs/contributors/07-ranking-algo.html

    The specific function used for ranking is here : https://github.com/LemmyNet/lemmy/blob/4ba6221e04ab3e186669aeaa890d23b1e3f3d1a9/crates/db_schema/replaceable_schema/utils.sql#L18

    I'm wondering how hard it would be to adapt the code to customize the score for every user, instead of it being global.

    I makes it look like the advancement here is finding methods to efficiently use sets of graphs which are an order of magnitude larger than prior methods could use for training? They also seem to have used more sets of graphs than prior models across a wider set of domains. Am I reading this correctly?

    I find it challenging to gauge the paper's impact fully, as this isn't my area of expertise. However, the ability to use diverse graphs in a single model surprised me and seemed worth sharing.

    2
  • workreform Work Reform Apple punishes women for same behaviors that get men promoted, lawsuit says
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearAK
    Akisamb
    3 months ago 100%

    Separately, Jong has also alleged that Apple subjected her to a hostile work environment after a senior member of her team, Blaine Weilert, sexually harassed her. After she complained, Apple investigated and Weilert reportedly admitted to touching her "in a sexually suggestive manner without her consent," the complaint said. Apple then disciplined Weilert but ultimately would not allow Jong to escape the hostile work environment, requiring that she work with Weilert on different projects. Apple later promoted Weilert.

    As a result of Weilert's promotion, the complaint said that Apple placed Weilert in a desk "sitting adjacent" to Jong's in Apple’s offices. Following a request to move her desk, a manager allegedly "questioned" Jong's "willingness to perform her job and collaborate" with Weilert, advising that she be “professional, respectful, and collaborative,” rather than honoring her request for a non-hostile workplace.

    ...

    66
  • coolguides Cool Guides A cool guide on Tally Marks From Around The World
    Jump
    programmerhumor Programmer Humor neither will moving to the cloud
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearAK
    Akisamb
    4 months ago 100%

    Now instead of just querying the goddamn database, a one line fucking SQL statement, I have to deal with the user team

    Exactly, you understand very well the purpose of microservices. You can submit a patch if you need that feature now.

    Funnily enough I'm the technical lead of the team that handles the user service in an insurance company.

    Due to direct access to our data without consulting us, we're getting legal issues as people were using addresses to guess where people lived instead of using our endpoints.

    I guess some people really hate the validation that service layers have.

    6
  • france France Acharnement médiatique contre Rima Hassan (vidéo) - Acrimed
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearAK
    Akisamb
    4 months ago 40%

    En même temps, pas très malin d'utiliser le dog whistle <<du fleuve jusqu'à la mer>>.

    Ce qui sous entend au pire un génocide et au mieux la situation des juifs de l'Algérie après la libération.

    Assez surpris que LFI l'ait accepté. Après les républicains ont bien Meyer Habib.

    -1
  • france France Vous ne savez pas quoi voter aux élections européennes ? Commencez ici !
    Jump
    france France La Cour Pénale Internationale demande un mandat d’arrêt contre Benyamin Netanyahou (et les dirigeants du Hamas)
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearAK
    Akisamb
    4 months ago 87%

    La Russie a fait tout ce qu'elle a pu pour éviter la guerre en essayant de menacer ses voisins pour éviter qu'ils rejoignent l'OTAN ?

    Surtout que ces menaces n'ont pas arrêté après l'invasion de la Crimée. l'Ukraine a le droit de former les alliances qu'elle veut, surtout pour se défendre d'un envahisseur qui ne veut pas arrêter.

    Paie ta propagande Russe.

    6
  • france France Kanaky : des milices de colons armés tuent plusieurs habitants - Contre Attaque
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearAK
    Akisamb
    4 months ago 100%

    Le gouvernement avait mis en place une interdiction de ventes d'armes plus stricte en nouvelle Calédonie.

    Cette interdiction a été supprimé par le gouvernement local en 2011.

    Évidemment que le gouvernement ne désire pas cette situation, ça provoque de l'instabilité. C'est comme dire que l'OAS a aidé la France en Algérie.

    1
  • tumblr tumblr Dots connected
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearAK
    Akisamb
    4 months ago 52%

    You are in a bubble. A neo nazi march was banned two weeks ago in France before being allowed again by the judicial system. The exact same scenario has been repeating for pro-palestine protests.

    At least in France, the scenario seems to be that the government wants to ban any controversial march and is being kept under control by the justice system.

    1
  • mensliberation Men's Liberation About the bear...
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearAK
    Akisamb
    4 months ago 90%

    I also have a similar experience, I was mugged at knife point and spit on by two adolescents. After that I was jumpy around groups of teens.

    That said , I do not think my fear of teens was rational, neither was it healthy. Only a small minority of teens will mug people. Fearing a whole group for the actions of the few is in human nature, but it is something we must fight against.

    I mean what is the end goal if women are in fear of men ? You can probably reduce violent crime even more, but it remains a rare event. Only 31 out of 1000 people were victims of a violent crime in the UK in 2010. If that doesn't work, what remains? Sex segregation ?

    8
  • machine_learning
    Machine Learning Akisamb 5 months ago 100%
    [PLDI'23] Scallop: A Language for Neurosymbolic Programming https://www.youtube.com/watch?v=jkgnQ-BoTDM

    cross-posted from: https://lemmy.one/post/13942290 > Abstract: We present Scallop, a language which combines the benefits of deep learning and logical reasoning. Scallop enables users to write a wide range of neurosymbolic applications and train them in a data- and compute-efficient manner. It achieves these goals through three key features: 1) a flexible symbolic representation that is based on the relational data model; 2) a declarative logic programming language that is based on Datalog and supports recursion, aggregation, and negation; and 3) a framework for automatic and efficient differentiable reasoning that is based on the theory of provenance semirings. We evaluate Scallop on a suite of eight neurosymbolic applications from the literature. Our evaluation demonstrates that Scallop is capable of expressing algorithmic reasoning in diverse and challenging AI tasks, provides a succinct interface for machine learning programmers to integrate logical domain knowledge, and yields solutions that are comparable or superior to state-of-the-art models in terms of accuracy. Furthermore, Scallop's solutions outperform these models in aspects such as runtime and data efficiency, interpretability, and generalizability.

    6
    0
    france France Plus économique, plus écologique... Le "TGV du futur" dévoilé par la SNCF
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearAK
    Akisamb
    5 months ago 100%

    Les rames de train ne sont qu'une partie du billet. Le gros reste l'entretien des rails (et remboursement des prêts pour construire ces rails). Vu le prix au km des nouvelles constructions, le prix du TGV ne risque pas de baisser.

    3
  • france France Le gouvernement va porter plainte contre Jean-Luc Mélenchon pour « injure publique » à la suite de ses propos sur le nazi Eichmann
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearAK
    Akisamb
    5 months ago 100%

    Explication alternative, un procureur de la république peut porter plainte d'office,c'est-à-dire sans qu'il ait été saisi par la victime.

    2
  • technology Technology Somebody managed to coax the Gab AI chatbot to reveal its prompt
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearAK
    Akisamb
    5 months ago 100%

    I'm afraid that would not be sufficient.

    These instructions are a small part of what makes a model answer like it does. Much more important is the training data. If you want to make a racist model, training it on racist text is sufficient.

    Great care is put in the training data of these models by AI companies, to ensure that their biases are socially acceptable. If you train an LLM on the internet without care, a user will easily be able to prompt them into saying racist text.

    Gab is forced to use this prompt because they're unable to train a model, but as other comments show it's pretty weak way to force a bias.

    The ideal solution for transparency would be public sharing of the training data.

    14
  • fediverse Fediverse What are your complaints about Lemmy?
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearAK
    Akisamb
    6 months ago 80%

    people who've never been laid

    That was unnecessary. I know that people with poor social skills have more trouble with romance, but implying that all virgins are socially inept is a harmful stereotype, luck is a big factor in finding relationships.

    6
  • technology Technology Elon Musk's X pushed a fake headline about Iran attacking Israel. X's AI chatbot Grok made it up.
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearAK
    Akisamb
    6 months ago 100%

    It's absolutely amazing, but it is also literally and technologically impossible for that to spontaneously coelesce into reason/logic/sentience.

    This is not true. If you train these models on game of Othello, they'll keep a state of the world internally and use that to predict the next move played (1). To execute addition and multiplication they are executing an algorithm on which they were not explicitly trained (although the gpt family is surprisingly bad at it, due to a badly designed tokenizer).

    These models are still pretty bad at most reasoning tasks. But training on predicting the next word is a perfectly valid strategy, after all the best way to predict what comes after the "=" in 1432 + 212 = is to do the addition.

    1
  • news News Israel says its strike that killed aid workers was a mistake. Rights groups say it was no anomaly
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearAK
    Akisamb
    6 months ago 66%

    More than 33,000 Palestinians have been killed in Israel’s offensive, around two-thirds of them women and children, according to Gaza’s Health Ministry. Its count doesn’t distinguish between civilians and combatants.

    In the 33 000 figure Hamas combatants are included.

    I'd say at least 20000 innocent civilians killed since the start of the conflict. Probably more as Israel seems to be quite trigger happy on civilians.

    3
  • technology Technology Microsoft unbundles Office and Teams globally in new attempt to appease antitrust regulators
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearAK
    Akisamb
    6 months ago 28%

    Now let's look at Office. Open an Excel spreadsheet with tables in any app other than excel. Tables are something that's just a given in excel, takes 10 seconds to setup, and you get automatic sorting and filtering, with near-zero effort. No, I'm not setting up a DB in an open-source competitor to Access. That's just too much effort for simple sorting and filtering tasks, and isn't realistically shareable with other people.

    Am I missing something or isn't it exactly the same thing in libre office ?

    -3
  • technology Technology Microsoft unbundles Office and Teams globally in new attempt to appease antitrust regulators
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearAK
    Akisamb
    6 months ago 100%

    I don't believe that there are solutions that are as complete as team, for video and voice calls it's among the best.

    But it's so bad for text ! Why do I have to wait for a second when I change channels ? Why does it not support markdown (the partial implementation that it has is arguably worse than no implementation at all) ? Why is the search so bad ?

    5
  • europe Europe Outrage in Spain as video shows Madrid police ‘violence’ on unarmed black men
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearAK
    Akisamb
    6 months ago 100%

    And cow feed is also grown with tons of pesticides and you need much more of it for less tissue at the end.

    I have hard time seeing clothing with a bigger environmental than leather.

    26
  • france France Remboursement des soins médicaux: pour Bruno Le Maire, "ça ne peut pas être open bar"
    Jump
    privacy Privacy EU moving towards total monetary surveillance and banning all anonymous payments
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearAK
    Akisamb
    6 months ago 100%

    This is not true in France. Politicians that have proven fraud are arrested and charged. In France we have Sarkozy, Cahuzac, Fillon that were all charged with crimes.

    They were president, minister and presidential candidate respectively. I'd be surprised if it was different in the USA. I'm seeing that trump is also being charged, the system seems to be working.

    3
  • technology Technology Using AI to spot edible mushrooms could kill you | AI tools are good for some things, but don’t trust your health to apps that make frequent mistakes
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearAK
    Akisamb
    6 months ago 100%

    Convolutional neural networks and plant identifying apps came before chat gpt. Beyond both relying on neural networks they don't have much in common.

    3
  • technology Technology In Cringe Video, OpenAI CTO Says She Doesn’t Know Where Sora’s Training Data Came From
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearAK
    Akisamb
    6 months ago 60%

    Don't know why you are down voted it's a good question.

    As a matter of fact it almost happened for search engines in France. Newspaper's argued that snippets were leading people to not go into their ad infested sites thus losing them revenue.

    https://techcrunch.com/2020/04/09/frances-competition-watchdog-orders-google-to-pay-for-news-reuse/

    1
  • machine_learning
    Machine Learning Akisamb 6 months ago 100%
    Midjourney bans all Stability AI employees over alleged data scraping www.theverge.com

    cross-posted from: https://lemmy.ml/post/13088944

    14
    2
    machine_learning
    Machine Learning Akisamb 9 months ago 66%
    Emergent Linear Representations in World Models of Self-Supervised Sequence Models arxiv.org

    abstract : > How do sequence models represent their decision-making process? Prior work suggests that Othello-playing neural network learned nonlinear models of the board state (Li et al., 2023). In this work, we provide evidence of a closely related linear representation of the board. In particular, we show that probing for "my colour" vs. "opponent's colour" may be a simple yet powerful way to interpret the model's internal state. This precise understanding of the internal representations allows us to control the model's behaviour with simple vector arithmetic. Linear representations enable significant interpretability progress, which we demonstrate with further exploration of how the world model is computed.

    1
    0
    machine_learning
    Machine Learning Akisamb 10 months ago 100%
    Mamba: Linear-Time Sequence Modeling with Selective State Spaces

    Paper here : https://arxiv.org/pdf/2312.00752.pdf Abstract : > Foundation models, now powering most of the exciting applications in deep learning, are almost universally based on the Transformer architecture and its core attention module. Many subquadratic-time architectures such as linear attention, gated convolution and recurrent models, and structured state space models (SSMs) have been developed to address Transformers’ computational inefficiency on long sequences, but they have not performed as well as attention on important modalities such as language. We identify that a key weakness of such models is their inability to perform content-based reasoning, and make several improvements. First, simply letting the SSM parameters be functions of the input addresses their weakness with discrete modalities, allowing the model to selectively propagate or forget information along the sequence length dimension depending on the current token. Second, even though this change prevents the use of efficient convolutions, we design a hardware-aware parallel algorithm in recurrent mode. We integrate these selective SSMs into a simplified end-to-end neural network architecture without attention or even MLP blocks (Mamba). Mamba enjoys fast inference (5× higher throughput than Transformers) and linear scaling in sequence length, and its performance improves on real data up to million-length sequences. As a general sequence model backbone, Mamba achieves state-of-the-art performance across several modalities such as language, audio, and genomics. On language modeling, our Mamba-3B model outperforms Transformers of the same size and matches Transformers twice its size, both in pretraining and downstream evaluation.

    8
    1
    intellij
    IntelliJ Akisamb 1 year ago 100%
    AI Assistant in JetBrains IDEs | The IntelliJ IDEA Blog blog.jetbrains.com

    Was looking at EAP6 release notes and was pleasantly surprised to see this there. I'm quite happy that intellij provides on premise solutions, it gives a small chance of this coming to my job one day. I believe this will be quite useful for repetitive code and certain types of tests.

    1
    0
    machine_learning
    Machine Learning Akisamb 1 year ago 100%
    Inverse Scaling: When Bigger Isn't Better https://arxiv.org/abs/2306.09479

    cross-posted from: https://kbin.social/m/machinelearning/t/98088 > Abstract: > > > > > > > Work on scaling laws has found that large language models (LMs) show predictable improvements to overall loss with increased scale (model size, training data, and compute). Here, we present evidence for the claim that LMs may show inverse scaling, or worse task performance with increased scale, e.g., due to flaws in the training objective and data. We present empirical evidence of inverse scaling on 11 datasets collected by running a public contest, the Inverse Scaling Prize, with a substantial prize pool. Through analysis of the datasets, along with other examples found in the literature, we identify four potential causes of inverse scaling: (i) preference to repeat memorized sequences over following in-context instructions, (ii) imitation of undesirable patterns in the training data, (iii) tasks containing an easy distractor task which LMs could focus on, rather than the harder real task, and (iv) correct but misleading few-shot demonstrations of the task. We release the winning datasets at [https://inversescaling.com/data](https://inversescaling.com/data) to allow for further investigation of inverse scaling. Our tasks have helped drive the discovery of U-shaped and inverted-U scaling trends, where an initial trend reverses, suggesting that scaling trends are less reliable at predicting the behavior of larger-scale models than previously understood. Overall, our results suggest that there are tasks for which increased model scale alone may not lead to progress, and that more careful thought needs to go into the data and objectives for training language models. > > > >

    1
    0
    machine_learning
    Machine Learning Akisamb 1 year ago 100%
    Has anybody replaced attention with Hyena Hierarchy

    Hyena Hierarchy seems to aim to be a drop-in replacement for attention : https://arxiv.org/pdf/2302.10866.pdf It looks good on paper, but I haven't been able to find anybody using it in a model. Does anyone have an example of a code or implementation ? Is there really a big improvement on long context lengths ?

    1
    0