• 2 Posts
  • 23 Comments
Joined 2Y ago
cake
Cake day: Mar 04, 2023

help-circle
rss

I have 20+ years of software development experience having to deal with user requests, so I am for sure sensitive to that fact! I don’t think that current LLMs can do anything but the most superficial change to code. But that doesn’t mean it always will, in 5-10 years, with realtime inference (e.g. 100x generations for the same prompt allowing for much better error correction) and video support, you could have a long session (say, 1 or 2 hours) of asking questions, reviewing mockups, tweaking the requirements, etc.) in order to understand the ask, and then the user will spend some time using it and testing it.


I sympathize, I also feel like the fight against the corporations is hopeless. The loss of leverage against employers for tech workers is huge in the face of LLMs. I’m a tech worker myself and am facing those same problems. But I’m not sure that this means that FOSS is useless. The corps have a huge incentive to create these tools, whether they’re open source or not. But at least when they’re open source, we the people can also use them. I’m not suggesting that we can do this with LLMs today, we just don’t have the right contributor and maintainer tools to do it. But right now we have to develop maintainer tools to filter out the huge amount of crap that badly designed LLM systems are putting out. This gives us the opportunity to build a contribution model that doesn’t care about human vs LLM provenance, as long as it meets certain quantifiable standards. In 5-10 years, we’re going to have LLMs that can infer at very high speed, meaning we can do a lot of error correction by multiplying the number of generations you make and looking for consistency. The engineering effort for LLM systems is barely started, these systems are gonna get way more robust. Wouldn’t it be better if these systems were built in the open so that we can all share, understand and leverage these tools for ourselves?

As for the gatekeeping/democratizing of art and tech, I agree that anyone can learn that stuff if they put enough effort into it. But by the simple fact that people need to put time and sweat into it, it disqualifies a large swath of the population, from children to neurodivergent people to low wage workers who don’t have the breathing room to rest let alone take up programming. It’s really not about a ‘soldier at the gate’, no person or group is preventing anyone from learning how to code. The social order and biology sometimes makes it so. Wouldn’t it be better for everyone if anyone could modify their software without having to invest a shitload of time to learn how to code? Like maybe this person only wants this one specific change in one specific app-- the ROI just isn’t there if they have to learn a whole new field.

I am not trying to say that AI and LLMs are the next best thing since sliced bread. I think there’s huge problems with it, but I also think that they can be powerful tools if we wield them properly. I think there’s big limitations on the tech, and huge ethical implications about the way they’re built and their cost to the planet. I’m hoping that we can fix these in the long run, but I sure as fuck don’t count on the current AI industry leaders to do it. They’re going to use this tech to supercharge surveillance capitalism, imo. It’s gonna be fucking horrible. What I hope is that we can carve out a space for personal computing with the help of FLOSS.


I agree that with the current state of tools around LLMs, this is very unadvisable. But I think we can develop the right ones.

  • We can have tools that can generate the context/info submitters need to understand what has been done, explain the choices they are making, discuss edge cases and so on. This includes taking screenshots as the submitter is using the app, testing period (require X amount of time of the submitter actually using their feature and smoothening out the experience)

  • We can have tools at the repo level that can scan and analyze the effect. It can also isolate the different submitted features in order to allow others to toggle them or modify them if they’re not to their liking. Similarly, you can have lots of LLMs impersonate typical users and try the modifications to make sure they work. Putting humans in the loop at different appropriate times.

People are submitting LLM generated code they don’t understand right now. How do we protect repos? How do we welcome these contributions while lowering risk? I think with the right engineering effort, this can be done.


Free to be Weird: Lowering barriers to Open Source contributions
Public code repositories like Github are currently being beset by a flood of LLM-generated contributions. It’s becoming a bit of a problem and is one of the facets of the Great Flood the web is currently experiencing. What does it look like when we are able to use LLMs to handle the flood of contributions? What happens when we’re able to screen and adopt PRs effectively with little to no human intervention? I use the [Voice audiobook app](https://github.com/PaulWoitaschek/Voice) to listen to my DRM-free books. In this app, there’s a configuration setting for auto-rewind. If you pause the book, when you resume, it will rewind by X seconds. I didn’t like that feature, I wanted the amount of seconds to rewind to be based on how long it has been since I’ve paused. So if I resume within a minute, no rewind; within 5 minutes, 10 second rewind; more than that would be 30 seconds. I can do this because I’m part of a small percentage of people who can clone a repo for an Android app, modify it, rebuild it and push it to my phone. But I don’t want this power to be constrained to a priesthood who know the secret language of coding. I want everyone to be able to do stuff like that. Imagine a world in which, as I use a specific piece of software, I can request modifications to its behaviour to an LLM-augmented system. That system will pull the open source code, make the necessary modifications (following the project’s contribution guidelines), build it and reload it on my device. Then I can use it and test it, and fix any problems that come along. That modification can then be uploaded to my own repo and made publicly available for anyone else who wants it, or it could even be pushed as a PR to the original system who could scan it for usefulness, alignment, UX, etc., modify it if needed, and then merge it to the main branch. This wonderful world of personal and communal computing would be unimaginable in a closed source world. No closed source system will accept an external AI to come in and read/modify it at will. This is why open source is more important than ever. We need to build a Software Commons so that we can give everyone the ability to adapt their digital lives to their liking. So that these intimate, private devices to which we entrust most of our attention, these things which have great effects on our cognitive and emotional functions, remain ours in a real sense. And the way that we do this is to create the tools and processes to allow anyone to make modifications to their software by simply expressing that intent. And what does communal software development look like? Let’s explore the space of social consensus mechanisms so we can find those that drive the creation of software which promote culture, connection, compassion and empathy. I want to see the promise of community made by the 90’s web survive the FAANG+ Megacorp Baronies and flourish into a great digital metropolis. The web can still get free to be weird, we just have to make it happen together.
fedilink


Another argument to give your tween a smartphone is that they need to learn how to use it, to develop a healthy relationship with it, to understand the pros/cons, to understand how to use it effectively. Abstinence will just make them envious and less likely to think through the consequences.


I get ya. I think there’s also a petulant sentiment of “you don’t want to play fair? Then fuck you, I won’t either”


No no, that is not what the headline says.

The headline says “you’re told that what you’re doing is buying by the people selling you the media, but that’s not what you’re actually doing. So, if they’re lying to you about what you’re buying, then pirating a different thing isn’t stealing the thing they are trying to sell you.”

It’s definitely tongue in cheek and has some hyperbole in it, but that is the gist of the statement.


Agreed, and to me the solution is not “let’s hope the companies play nice”, but rather to bring in anti-monopoly regulations, like Canada’s Bill C-56.

We need to force companies to add interoperability, transparency and fairness imho. Like the ongoing fight to force Apple to allow competing browsers in iOS. Or alternate app stores for Android and iOS.


Ah, that’s not my understanding of civil disobedience. I prefer this definition: “civil disobedience is a public, non-violent and conscientious breach of law undertaken with the aim of bringing about a change in laws or government policies” (https://plato.stanford.edu/entries/civil-disobedience/)

I suppose the piracy aspect might not be public enough to count as civil disobedience though, unless you count as public the noticeable cumulative effects of all piracy.


There’s lots they can do…

  • cheaper prices (by lowering the % of rent-seeking),
  • better pay distribution for creators (Especially so that I pay to support the shows I watch rather than a global pool),
  • interoperability (to allow new businesses which provide frontends to multiple streaming services),
  • social (clipping and sharing, group watching, etc)
  • more equal promotion of shows/movies (instead of based on royalty rates)

How much should they be paid for it? In a situation where the streaming services have a stranglehold on the market and are extracting a big amount in rent-seeking price vs actually paying the people who labored to create it, should we continue to pay and give in to their morally dubious tactics? In this lens, can piracy be considered a form of civil disobedience?


I’m not so sure that’s true. What if normalizing and removing friction from piracy gets to the point where the streaming services have to react by providing better services and better payouts?


Yeah, agreed and every person can only do so much. I like to think that it’s all the same fight, it’s the fight against the stranglehold that the rich have on the rest of us.


That’s the point, though. Spotify is rigged specifically so that they don’t have to pay small artists. Spotify splits the pot with the Big Three and everyone else can go fuck themselves. I would much rather my monthly payment go toward the artists I actually listen to. Instead, most of a monthly payment goes to the most played artists-- which Spotify rigs to be whoever nets them the most money (low royalty artists, high dividends for Spotify and the Big Three who are highly invested in it)


Cory Doctorow writes extensively about how it’s Spotify’s fault, as an extension of the common exploitation of musicians in the industry, in the excellent book Chokepoint Capitalism. Here’s a short summary of the Spotify argument by the author: https://www.youtube.com/watch?v=FZ5z_KKeFqE


What Spotify does affects the entire music market. Why should you worry about their income? Because Spotify’s strategy makes it harder and harder for musicians to have the income to keep on making music. If you care about having music to listen to, you should care about this. Also, Spotify and music is just one example of the overall exploitation of workers. If you don’t stand for artists when it’s their livelihood at stake, why should anyone stand up for your rights when it’s your livelihood at stake?


I agree that the technologies did pan out, but I don’t think it’s an ignorant opinion.

I also feel blasé about the new battery articles because they tend to promise orders of magnitude changes rather than incremental change. Batteries did get much better, but it doesn’t really feel that way I suppose. Our experience of battery power hasn’t changed much.

It’s really about getting excited about the article or the tech, it takes so long to see its mild effects that there’s no real cashing out on the excitement, so it’s not very satisfying.


Agreed. It’s such a disingenuous argument. It’s the usual casting of poor people as lazy, and what they need is a good lashing to get them to work.

Like… No. People want dignity. People want to feel satisfied in their lives. UBI trials have shown that they use that money to get the life/jobs that they want. They’re just not gonna be forced into shitty jobs as you said. This last bit is the part not said out loud.


I summarized the two readings of the bill. (Claude AI did, really)

The first speech from the Sponsor (February 8, 2022)

Senator Pate gave a speech introducing Bill S-233, which would create a national framework to implement a guaranteed livable basic income program in Canada. She argued that poverty is a major social issue that needs to be urgently addressed. The COVID-19 pandemic has exacerbated income inequality and disproportionately affected marginalized groups. A guaranteed livable income could improve health, social, and economic outcomes for low-income Canadians.

The speech outlined how poverty puts people at greater risk of poor health, food insecurity, and homelessness. COVID-19 has spotlighted these vulnerabilities, as lower-income groups have suffered higher mortality rates. Senator Pate cited research showing guaranteed income pilots reduced hospital visits and improved participants’ health. She argued a national program is feasible, building on existing supports like the Canada Child Benefit. Costs could be offset by reducing other programs and realizing savings in areas like healthcare.

There is growing momentum for guaranteed income, with support across party lines. Public opinion also favors it. Senator Pate positioned the bill as responding to decades of calls to action on poverty reduction. She appealed to fellow Senators to stop perpetuating myths about poverty and act boldly to implement this long-overdue policy. The speech was a compelling case for guaranteed income as a powerful tool for promoting equity and dignity.

The Response (April 18, 2023)

Senator MacDonald responded to Senator Pate’s speech introducing Bill S-233, which would create a framework for a guaranteed basic income (GBI) program in Canada. He commended Senator Pate’s advocacy for the poor, but expressed concerns about the bill’s lack of detail and fiscal implications.

Senator MacDonald outlined analyses questioning the affordability and sustainability of a GBI program. He cited research suggesting it could cost hundreds of billions annually, require tax increases, and reduce work incentives. Senator MacDonald also noted provincial studies concluding GBI is too costly and ineffective for poverty reduction compared to targeted measures.

Given Canada’s debt and deficits, Senator MacDonald argued the country cannot realistically consider implementing GBI currently. He contended the solution is generating wealth through natural resource development, not expanding welfare states. Senator MacDonald suggested Conservatives could support GBI to replace current programs if fiscal conditions improve under a future Conservative government.

In conclusion, Senator MacDonald maintained Conservatives oppose Bill S-233. While GBI aims are laudable, he believes the bill’s lack of detail and Canada’s finances make it unrealistic presently. He advocated defeating the bill or sending it to committee for further scrutiny.

Discussion last Tuesday (Oct 17)

I’ll put up a summary of the transcript once it becomes available or if I can extract it from the video.


There’s lots of alternate, free and open source syncing solutions. I use syncthing myself.


But the main result is achieved anyway, right? The picture that the system tried to download did not make it into the training set.


But you can work with it to write all the tests/acceptance criteria and then have the AI run the code against the tests. We spent a lot of time developing processes for humans writing code, we need to continue integrating the machines into these processes. It might not do 100% of the work you’re currently doing, but it could do maybe 50% reliably. That’s still pretty disruptive!



I've been working on honing my architectural skills and came across this interesting article that put some things in perspective for me. Maybe it will help you too!
fedilink