• 81 Posts
  • 63 Comments
Joined vor 9 Monaten
cake
Cake day: Apr. 18, 2022

help-circle
rss
Chatbot web app + HTTP and Websocket endpoints for BLOOM-176B inference with the Petals client
[Repo](https://github.com/borzunov/chat.petals.ml) [Petals](https://github.com/bigscience-workshop/petals)
fedilink

Why don't we see more distributed large language model projects?
I was wondering this after seeing the following ["Run 100B+ language models at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading" - this approach might be useful for SD-type models too Discussion](https://github.com/bigscience-workshop/petals) > Worthy of note... If the model is split up layerwise (it seems there are 80 layers), each layer is only 2.5GB of weights. > > Not much communication happens between layers at inference time - just a couple of kilobytes of activations per token (~word) of output generated. > > That means it's theoretically possible to split the work between machines across the internet, and 80 volunteers could run this on regular machines to get the whole thing running. > > — By [u/londons_explorer](https://reddit.com/user/londons_explorer) on [[D] Has anyone got YaLM-100B to run?](https://reddit.com/r/MachineLearning/comments/vpn0r1/d_has_anyone_got_yalm100b_to_run/)
fedilink

How can I visit the main page of another instance?
To see a community from another instance I can write ``` https://lemmy.ml/c/community@instance ``` For example ``` https://lemmy.ml/c/linux@heapoverflow.ml ``` How can I visit the main page instead of a community from another instance?
fedilink

That could be automated. A possible future feature. I don’t care about it enough to open an issue though.


Someone could have a custom instance with an affinity page that showed other users sorted by percentage affinity with the current user.



You can see who upvotes and downvotes Lemmy posts
A curiosity I didn't know about Lemmy. > However, I just noticed a place where there is some lack of informed consent here on Lemmy: in the Lemmy UI, it appears that upvotes and downvotes are anonymous. I checked a long time ago, and realized that they weren’t really; the identity of the up or down voter is federated, but it is simply not shown by the UI. > > I would assume that many (probably most) lemmy users do not realize this: admins of your own instance and all federated instances have the ability to see who upvoted and downvoted what. > > It just now came to my attention that Friendica actually is showing this information publicly, in the form of “$username does not like this” for a downvote! > > — By [@cypherpunks@lemmy.ml](https://lemmy.ml/u/cypherpunks) on [Great fedi thread on consent](https://lemmy.ml/post/732593/comment/378308)
fedilink

I had forgotten about popcorntime. I think that’s the best alternative right now.



Alternative to stremio + torrentio?
For some reason this has stopped working for me. Is there any alternative for streaming torrents with the discovery that stremio offers? I know I can use jellyfin + ombi + prowlarr + radarr, but installing and configuring it isn't as simple as with stremio. Something like this using Jellyfin would be nice: https://github.com/klutchell/mediaserver
fedilink

if you have two NVIDIA RTX 3080 GPUs, you should be able to run

I look forward to trying it in a decade when RTX 3080 are cheaper.


CodeGeeX 14B (pronounced ‘code-geeks’) by Tsinghua. 850B tokens for 14B params (open weights, non-commercial).

Website: https://codegeex.ai

Demo: https://huggingface.co/spaces/THUDM/CodeGeeX

Repo: https://github.com/THUDM/CodeGeeX




Where was this announced? When they release it, I want to know.
fedilink

I’ve also heard of Pacstall and LURE but they have a long way to go to catch up with AUR. I think the closest to AUR for Ubuntu would be Homebrew.





Self hosted alternative to the internet archive?
I'm looking for a self-hosted alternative to the internet archive. A website to share media where users can only see the media if they have an account and they can help curate the media and upload new media to earn points and use the points to download media. What are the closest projects to this?
fedilink





That’s what we have now but it fails at level 1 because many moderators haven’t even connected in months.



Utilize community-driven rules: By allowing users to create and vote on their own rules and guidelines for each community, the users can take ownership of its own moderation process. This can also help to ensure that the rules are fair and relevant to the community.


Implement a reputation system: This allows users to earn points or reputation for their contributions to the community. This can be based on the number of upvotes their posts receive, the quality of their comments, and the amount of time they spend engaging with the community. Users with higher reputations can have more privileges, such as being able to report inappropriate content or flag inappropriate comments.


Upvoting and downvoting system: Allow users to upvote or downvote content, and have a threshold for visibility or removal. This allows the community to collectively decide which content is appropriate and valuable.


I think a trust level system like the one from discourse would be more effective, that way all the responsibility doesn’t fall on a few users that will get tired fast. The only action the admins should need to take is changing the trust levels of the top of the hierarchy to shape their instance the way they want it to be. Other than that they shouldn’t need to do anything. I think a system that had an increasingly small number of users on the top trust levels so that admins only have to moderate a few users would be the best.



cross-posted from: https://lemmy.ml/post/655410 > - [Codidact](https://codidact.org) > - [Software Development](software.codidact.com) > > Made by some of the moderators and users who left stackoverflow after the whole [Monica Cellio incident in 2019](https://worldbuilding.meta.stackexchange.com/questions/7649/what-does-reinstate-monica-mean)
fedilink

- [Codidact](https://codidact.org) - [Software Development](software.codidact.com) - StackOverflow alternative. Made by some of the moderators and users who left StackOverflow after the whole [Monica Cellio incident in 2019](https://worldbuilding.meta.stackexchange.com/questions/7649/what-does-reinstate-monica-mean).
fedilink

Is there a program to do UI layout mockup?
I want to design the user interface for a program in Linux. The only thing I know that I could use right now is Xournal++. Is there any other programs that work for this?
fedilink


Yeah I think similar communities from federated instances should all show the same content. Otherwise you would have to be constantly checking the rules for each of the different 100 technology communities to find the one that fits your post best. As if anyone would do that.

But I haven’t given this much thought. There may be better solutions.


But people are going to post the same things on both, they don’t know the reason why you created another community.


If other instances are discouraged from having similar communities to all the other instances they are federated with, what is the point of those instances existing at all?


Sorry, I mean, given a text get the hashtags appropriate to use with the text.


The maintainer is shutting the server down. He was looking for someone else to maintain the project and I don’t think he found anybody. When I used it, it didn’t connect because the bootstrap server was down and he had to turn it on. So going forward, and without no-one doing that, there’s probably no way to connect to the network. Also I didn’t found anything when I used it. It’s I2P over gnutella network and has swarming, but I guess it’s slow because of the onion routing and it didn’t gain traction.