RAszCcnWVT

https://w3id.org/np/RAszCcnWVTYomkTM0J8K9p0PSp-gwfAIP8oDv_sfGKsdQ

 CoSMO Semantic Post SemanticPost ▼ comment... approve/disapprove... edit as derived nanopublication...

https://github.com/zipnn/zipnn

zipnn

https://sense-nets.xyz/hasZoteroItemType

hasZoteroItemType

(this is a literal)

"computerProgram"

.

https://www.alphaxiv.org/abs/2408.13656

2408.13656

https://sense-nets.xyz/hasZoteroItemType

hasZoteroItemType

(this is a literal)

"webpage"

.

https://www.alphaxiv.org/pdf/2310.01886

2310.01886

https://sense-nets.xyz/hasZoteroItemType

hasZoteroItemType

(this is a literal)

"webpage"

.

https://www.alphaxiv.org/pdf/2405.07813

2405.07813

https://sense-nets.xyz/hasZoteroItemType

hasZoteroItemType

(this is a literal)

"webpage"

.

https://www.arxiv.org/abs/2407.00066

2407.00066

https://sense-nets.xyz/hasZoteroItemType

hasZoteroItemType

(this is a literal)

"webpage"

.

https://x.com/RickardGabriels/status/1810368375455207470

status/1810368375455207470

https://sense-nets.xyz/hasZoteroItemType

hasZoteroItemType

(this is a literal)

"forumPost"

.

https://x.com/prateeky2806/status/1727589818618523783

status/1727589818618523783

https://sense-nets.xyz/hasZoteroItemType

hasZoteroItemType

(this is a literal)

"forumPost"

.

https://x.com/pratyusha_PS/status/1739025292805468212

status/1739025292805468212

https://sense-nets.xyz/hasZoteroItemType

hasZoteroItemType

(this is a literal)

"forumPost"

.

This is the identifier for the assertion of this nanopublication. https://w3id.org/np/RAszCcnWVT...#assertion

this assertion

http://purl.org/dc/terms/creator

creator

https://w3id.org/np/RAoSadUw99...

Leshem Choshen 🤖🤗 @ICML wanna talk?

.

This is the identifier for the assertion of this nanopublication. https://w3id.org/np/RAszCcnWVT...#assertion

this assertion

http://purl.org/spar/cito/agreesWith

agreesWith

https://x.com/RickardGabriels/status/1810368375455207470

status/1810368375455207470

.

This is the identifier for the assertion of this nanopublication. https://w3id.org/np/RAszCcnWVT...#assertion

this assertion

http://purl.org/spar/cito/agreesWith

agreesWith

https://x.com/pratyusha_PS/status/1739025292805468212

status/1739025292805468212

.

This is the identifier for the assertion of this nanopublication. https://w3id.org/np/RAszCcnWVT...#assertion

this assertion

http://purl.org/spar/cito/discusses

discusses

https://www.alphaxiv.org/abs/2408.13656

2408.13656

.

This is the identifier for the assertion of this nanopublication. https://w3id.org/np/RAszCcnWVT...#assertion

this assertion

http://purl.org/spar/cito/discusses

discusses

https://www.alphaxiv.org/pdf/2310.01886

2310.01886

.

This is the identifier for the assertion of this nanopublication. https://w3id.org/np/RAszCcnWVT...#assertion

this assertion

http://purl.org/spar/cito/discusses

discusses

https://www.alphaxiv.org/pdf/2405.07813

2405.07813

.

This is the identifier for the assertion of this nanopublication. https://w3id.org/np/RAszCcnWVT...#assertion

this assertion

http://purl.org/spar/cito/discusses

discusses

https://x.com/prateeky2806/status/1727589818618523783

status/1727589818618523783

.

This is the identifier for the assertion of this nanopublication. https://w3id.org/np/RAszCcnWVT...#assertion

this assertion

http://purl.org/spar/cito/includesQuotationFrom

includesQuotationFrom

https://x.com/RickardGabriels/status/1810368375455207470

status/1810368375455207470

.

This is the identifier for the assertion of this nanopublication. https://w3id.org/np/RAszCcnWVT...#assertion

this assertion

http://purl.org/spar/cito/includesQuotationFrom

includesQuotationFrom

https://x.com/pratyusha_PS/status/1739025292805468212

status/1739025292805468212

.

This is the identifier for the assertion of this nanopublication. https://w3id.org/np/RAszCcnWVT...#assertion

this assertion

http://www.w3.org/2000/01/rdf-schema#comment

comment

(this is a literal)

" You only learn a few parameters, with your parameter "efficient" finetuning. The rest is💩 A whole line of works🧵 shows that by throwing redundancy we can get better LoRas, keep less memory and of course model merge https://twitter.com/LChoshen/status/1833879920348422216/photo/1 ComPeft shows you can improve LoRAs by pruning aggressively and making the remaining weights binary (+/-) It also means parameter efficiency still relies on overparametrization(but only during training) https://x.com/prateeky2806/status/1727589818618523783 Laser shows it on full models https://x.com/pratyusha_PS/status/1739025292805468212 https://twitter.com/LChoshen/status/1833879922500080084/photo/1 In merging, many find that with only those few weights one can make a "multitask" model, keeping the important ones for each model and switching. those e.g. 1% of the weights also represent tasks well Many.. https://www.alphaxiv.org/abs/2408.13656 https://www.alphaxiv.org/pdf/2405.07813 https://www.alphaxiv.org/pdf/2310.01886 Those works are focused on efficient multitask learning that compresses the models, can keep many models and switch between them as necessary. Another option to compress is to SVD the LORA, separately or to a shared space, saving the tiny differences https://x.com/RickardGabriels/status/1810368375455207470 And just because we discussed compression, of course this is all just "model compression" if you want to compress to just save space, there are smarter ways: https://github.com/zipnn/zipnn "

.

This is the identifier for the assertion of this nanopublication. https://w3id.org/np/RAszCcnWVT...#assertion

this assertion

https://schema.org/keywords

keywords

(this is a literal)

"finetuning"

.

This is the identifier for the assertion of this nanopublication. https://w3id.org/np/RAszCcnWVT...#assertion

this assertion

https://schema.org/keywords

keywords

(this is a literal)

"low-rank-adapters"

.

This is the identifier for the assertion of this nanopublication. https://w3id.org/np/RAszCcnWVT...#assertion

this assertion

https://schema.org/keywords

keywords

(this is a literal)

"model-compression"

.

This is the identifier for the assertion of this nanopublication. https://w3id.org/np/RAszCcnWVT...#assertion

this assertion

https://schema.org/keywords

keywords

(this is a literal)

"multitask-learning"

.

This is the identifier for the assertion of this nanopublication. https://w3id.org/np/RAszCcnWVT...#assertion

this assertion

https://schema.org/keywords

keywords

(this is a literal)

"serving-systems"

.

This is the identifier for the assertion of this nanopublication. https://w3id.org/np/RAszCcnWVT...#assertion

this assertion

https://sense-nets.xyz/endorses

endorses

https://www.arxiv.org/abs/2407.00066

2407.00066

.

This is the identifier for the assertion of this nanopublication. https://w3id.org/np/RAszCcnWVT...#assertion

this assertion

https://sense-nets.xyz/recommends

recommends

https://github.com/zipnn/zipnn

zipnn

.

This is the identifier for the assertion of this nanopublication. https://w3id.org/np/RAszCcnWVT...#assertion

this assertion

https://sense-nets.xyz/summarizes

summarizes

https://www.arxiv.org/abs/2407.00066

2407.00066

.

This is the identifier for the assertion of this nanopublication. https://w3id.org/np/RAszCcnWVT...#assertion The assertion above http://www.w3.org/ns/prov#linksTo

linksTo

https://x.com/LChoshen/status/1833879920348422216

status/1833879920348422216

.

This is the identifier for the assertion of this nanopublication. https://w3id.org/np/RAszCcnWVT...#assertion The assertion above http://www.w3.org/ns/prov#wasAssociatedWith

wasAssociatedWith

https://x.com/LChoshen

LChoshen

.

This is the identifier for the assertion of this nanopublication. https://w3id.org/np/RAszCcnWVT...#assertion The assertion above http://www.w3.org/ns/prov#wasAttributedTo

wasAttributedTo

https://orcid.org/0000-0002-0085-6496

0000-0002-0085-6496

.

This is the identifier for the assertion of this nanopublication. https://w3id.org/np/RAszCcnWVT...#assertion The assertion above http://www.w3.org/ns/prov#wasAttributedTo

wasAttributedTo

https://w3id.org/np/RAoSadUw99...

Leshem Choshen 🤖🤗 @ICML wanna talk?

.

This is the identifier for the assertion of this nanopublication. https://w3id.org/np/RAszCcnWVT...#assertion The assertion above http://www.w3.org/ns/prov#wasGeneratedBy

wasGeneratedBy

This is a local identifier minted within the nanopublication. https://w3id.org/np/RAszCcnWVT...#activity

activity

.

https://sense-nets.xyz/

Sensenets

http://www.w3.org/1999/02/22-rdf-syntax-ns#type

type

http://www.w3.org/ns/prov#SoftwareAgent

SoftwareAgent

.

https://sense-nets.xyz/

Sensenets

http://www.w3.org/ns/prov#actedOnBehalfOf

actedOnBehalfOf

https://w3id.org/np/RAoSadUw99...

Leshem Choshen 🤖🤗 @ICML wanna talk?

.

https://w3id.org/np/RAoSadUw99...

Leshem Choshen 🤖🤗 @ICML wanna talk?

http://xmlns.com/foaf/0.1/account

account

https://orcid.org/0000-0002-0085-6496

0000-0002-0085-6496

.

https://w3id.org/np/RAoSadUw99...

Leshem Choshen 🤖🤗 @ICML wanna talk?

http://xmlns.com/foaf/0.1/account

account

https://x.com/LChoshen

LChoshen

.

This is a local identifier minted within the nanopublication. https://w3id.org/np/RAszCcnWVT...#activity

activity

http://www.w3.org/1999/02/22-rdf-syntax-ns#type

type

https://sense-nets.xyz/supervisedActivity

supervisedActivity

.

This is a local identifier minted within the nanopublication. https://w3id.org/np/RAszCcnWVT...#activity

activity

http://www.w3.org/ns/prov#wasAssociatedWith

wasAssociatedWith

https://sense-nets.xyz/

Sensenets

.

https://w3id.org/np/RAoSadUw99...

Leshem Choshen 🤖🤗 @ICML wanna talk?

http://xmlns.com/foaf/0.1/name has the name (this is a literal)

"Leshem Choshen 🤖🤗 @ICML wanna talk?"

.

This is the identifier for this whole nanopublication. https://w3id.org/np/RAszCcnWVT... This nanopublication http://www.w3.org/2000/01/rdf-schema#label has the label (this is a literal)

"CoSMO Semantic Post"

.

This is the identifier for this whole nanopublication. https://w3id.org/np/RAszCcnWVT... This nanopublication http://purl.org/nanopub/x/hasNanopubType has the type https://sense-nets.xyz/SemanticPost

SemanticPost

.

This is the identifier for this whole nanopublication. https://w3id.org/np/RAszCcnWVT... This nanopublication date and time when the nanopublication was created http://purl.org/dc/terms/created was created on (this is a literal)

"2024-09-11T18:07:24.837Z"

(xsd:dateTime) .

This is a local identifier minted within the nanopublication. https://w3id.org/np/RAszCcnWVT...#sig

sig

http://purl.org/nanopub/x/hasSignatureTarget has as target This is the identifier for this whole nanopublication. https://w3id.org/np/RAszCcnWVT... this nanopublication .

This is a local identifier minted within the nanopublication. https://w3id.org/np/RAszCcnWVT...#sig

sig

http://purl.org/nanopub/x/hasAlgorithm has the algorithm (this is a literal)

"RSA"

.

This is a local identifier minted within the nanopublication. https://w3id.org/np/RAszCcnWVT...#sig

sig

http://purl.org/nanopub/x/hasPublicKey has the public key (this is a literal)

"MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEArHtI92jm8pAYVsvJabxLGfOT+7G0JyJGh2gwjB5x2pFPga6wWTd+rNBWWUZViIFnaJrBEsJpgdnoupLU9ppwn+khMiGRfxqGsDDzwHcj3Jc75CRys7d3etwXdBdoXfBgjsJiZBazwm13idr6tljRrC1TaEJBnRQAqzBw9cLDeGY77cSznzXT39feUGT168dpCSE9O6u/48DvvWVqciHGsH9cQ+LroJJVsMrorwtsdZnAK+q48wtIP6pIpw5shSJ5LnA0qeN/f4TvTFDV6ItYIXjiWWpTECc/Bxmfnyat3B5xWCu9nvz8fEs7Ns0TuzQwT3/K55iSKDEIi/E0nO97xwIDAQAB"

.

This is a local identifier minted within the nanopublication. https://w3id.org/np/RAszCcnWVT...#sig

sig

http://purl.org/nanopub/x/hasSignature has the signature (this is a literal)

"lUGuTihITpSBPC1WF/Na8tXgPw2UeCdCKt1Z7VLl0Aq1DKhqi52cROTJZ0PhS/unqNjVpM+W8BiMHbwSNH5zDsT04upJOTVdHC2ghxFXO2jZ2YeFoZe8ZrOUkVrsO4fDytVI8AptUiDDOn3tWN13J70E+2utIO7SBjG/pitQ62t7Nj1N1qZVHehz7McKlIfP3IB6arWD9WOHIU4lYlpyYFsYE7dlHBvjdW8gr4xwPSChdB356QdPXYphIwjVZBlMujhZhStKs5oVdlfKnfqvYxf8Dfsdh+paShLwmBR3hfJ4NN8ADDkW/VDbOvDzYgqLb2decJxM2PStBT84SH0yRg=="

.

This is the identifier for this whole nanopublication. https://w3id.org/np/RAszCcnWVT... This nanopublication http://purl.org/nanopub/x/wasCreatedAt was created at https://sense-nets.xyz/

Sensenets

.

https://w3id.org/np/RAoSadUw99...

Leshem Choshen 🤖🤗 @ICML wanna talk?

http://xmlns.com/foaf/0.1/account

account

https://orcid.org/0000-0002-0085-6496

0000-0002-0085-6496

.

This is a local identifier minted within the nanopublication. https://w3id.org/np/RAszCcnWVT...#sig

sig

http://purl.org/nanopub/x/singedBy

singedBy

https://sense-nets.xyz/

Sensenets

.

This is a local identifier minted within the nanopublication. https://w3id.org/np/RAszCcnWVT...#sig

sig

http://www.w3.org/ns/prov#wasAssociatedWith

wasAssociatedWith

https://w3id.org/np/RAoSadUw99...T86OrTzk16VtssigningDelegation

RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16VtssigningDelegation

.

This is the identifier for this whole nanopublication. https://w3id.org/np/RAszCcnWVT...

this nanopublication

http://purl.org/dc/terms/creator

creator

https://w3id.org/np/RAoSadUw99...

Leshem Choshen 🤖🤗 @ICML wanna talk?

.

This is the identifier for this whole nanopublication. https://w3id.org/np/RAszCcnWVT...

this nanopublication

http://purl.org/dc/terms/license

license

https://creativecommons.org/licenses/by/4.0/

4.0

.

This is the identifier for this whole nanopublication. https://w3id.org/np/RAszCcnWVT...

this nanopublication

http://www.w3.org/ns/prov#wasAttributedTo

wasAttributedTo

https://orcid.org/0000-0002-0085-6496

0000-0002-0085-6496

.

This is the identifier for this whole nanopublication. https://w3id.org/np/RAszCcnWVT...

this nanopublication

https://sense-nets.xyz/hasRootSigner

hasRootSigner

(this is a literal)

"0xf6ECcfD463afB464dcC85b051DF2E93E2646E6D2"

.

Sensenets, 11 Sep 2024, 18:07:24 UTC

References