post text your computer has generated [algorithmic writing]

[william_kent]

if you wanted that access that is above colab pro, what do you do? where do you go? can you pay a bit more and get a sub to something that will deliver stuff almost real-time? but i mean not dall-e or anything like that. off back of colab style custom notebook i mean

it gets a bit tricky above the "colab" level - I found on colab that fine-tuning gpt2 on a corpus consisting of a 50 MB text file that it would just time out after a certain number of "epochs" - the trick is to try and modify the python code to save "checkpoints" every so often... but if that's not good enough then you're looking at getting some time on an HPC ( high performance computing ) system, which unfortunately is out of the question for the majority of us...

 

[catalog]

yeah that's what i mean i think. cos i wanna try real-time in-the-forest generation of videos off drawings and text if possible.

 

[wektor]

if you wanted that access that is above colab pro, what do you do? where do you go? can you pay a bit more and get a sub to something that will deliver stuff almost real-time? but i mean not dall-e or anything like that. off back of colab style custom notebook i mean

I think there is plenty services which provide you with a remote that you access through jupyter running in your browser.
I wouldn't recommend AWS since it sucks in terms of getting data/in out (plus fuck amazon), but you can rent an a100 on runpod or something and run your stuff same as one would with colab.

 

[wektor]

also if you wanna leave it without timing out and don't need to hold onto like 20gb of training data - kaggle is your best bet most likely.
they have a monthly cap of I thinking 50h per month, but you can leave the run for I think 24h and it won't time out. and saves the stuff, which saves you from the suicidal mindset colab puts one into when disconnecting.

 

[wektor]

or find a mate with a gaming pc

 

[catalog]

or find a mate with a gaming pc

as it happens, i'm getting a gaming laptop soon, as a sort of loan for 10 weeks, will have admin rights on it to dl what i want:

Gaming Laptop:
ROG Strix G17 - G713RW-LL070W

PC core components:
Operating System Windows 11 Home

Processor
AMD Ryzen™ 9 6900HX Mobile Processor (8-core/16-thread, 20MB cache, up to 4.9 GHz max boost)

Graphics
NVIDIA® GeForce RTX™ 3070 Ti Laptop GPU ROG Boost: 1460MHz* at 150W (1410MHz Boost Clock+50MHz OC, 125W+25W Dynamic Boost) 8GB GDDR6

Display
17.3-inch WQHD (2560 x 1440) 16:9 IPS-level Anti-glare display DCI-P3:100.00% Refresh Rate:240Hz Response Time:3ms Adaptive-Sync MUX Switch + Optimus Support Dolby Vision HDR :Yes

Memory
8GB DDR5-4800 SO-DIMM x 2 Max Capacity:32GB Support dual channel memory

Storage
1TB PCIe® 4.0 NVMe™ M.2 SSD

I/O Ports
1x 3.5mm Combo Audio Jack 1x HDMI 2.1 TMDS 1x USB 3.2 Gen 2 Type-C support display / power delivery 1x USB 3.2 Gen 2 Type-C 2x USB 3.2 Gen 1 Type-A 1x 2.5G LAN port

Keyboard and Touchpad
Backlit Chiclet Keyboard Per-Key RGB Touchpad

Audio
Smart Amp Technology Audio by Dolby Atmos AI noise-canceling technology Hi-Res certification Built-in array microphone 2-speaker system with Smart Amplifier Technology

Network and Communication
Wi-Fi 6E(802.11ax) (Triple band) 2*2 + Bluetooth® 5.2 (*Bluetooth® version may change with OS version different.) -RangeBoost

Battery
90WHrs, 4S1P, 4-cell Li-ion

Power Supply
ø6.0; 240W AC Adaptor; Output: 20V DC, 12A, 240W; Input: 100~240C AC 50/60Hz universal AURA SYNC Yes Device Lighting Aura Sync Light Bar

Weight
2.90 Kg (6.39 lbs)

So I basically need to do stable diffusion or VQGAN + CLIP off a colab type workbook, but x5 sessions at once ideally, sending initial image and text, plus target image, to create a 30 second video. and ideally want it to run off hotspot not wifi. probably not possible?

 

[william_kent]

this might be the next big thing:

high resolution video synthesis with latent diffusion

 

[wektor]

as it happens, i'm getting a gaming laptop soon, as a sort of loan for 10 weeks, will have admin rights on it to dl what i want:

Gaming Laptop:
ROG Strix G17 - G713RW-LL070W

PC core components:
Operating System Windows 11 Home

Processor
AMD Ryzen™ 9 6900HX Mobile Processor (8-core/16-thread, 20MB cache, up to 4.9 GHz max boost)

Graphics
NVIDIA® GeForce RTX™ 3070 Ti Laptop GPU ROG Boost: 1460MHz* at 150W (1410MHz Boost Clock+50MHz OC, 125W+25W Dynamic Boost) 8GB GDDR6

Display
17.3-inch WQHD (2560 x 1440) 16:9 IPS-level Anti-glare display DCI-P3:100.00% Refresh Rate:240Hz Response Time:3ms Adaptive-Sync MUX Switch + Optimus Support Dolby Vision HDR :Yes

Memory
8GB DDR5-4800 SO-DIMM x 2 Max Capacity:32GB Support dual channel memory

Storage
1TB PCIe® 4.0 NVMe™ M.2 SSD

I/O Ports
1x 3.5mm Combo Audio Jack 1x HDMI 2.1 TMDS 1x USB 3.2 Gen 2 Type-C support display / power delivery 1x USB 3.2 Gen 2 Type-C 2x USB 3.2 Gen 1 Type-A 1x 2.5G LAN port

Keyboard and Touchpad
Backlit Chiclet Keyboard Per-Key RGB Touchpad

Audio
Smart Amp Technology Audio by Dolby Atmos AI noise-canceling technology Hi-Res certification Built-in array microphone 2-speaker system with Smart Amplifier Technology

Network and Communication
Wi-Fi 6E(802.11ax) (Triple band) 2*2 + Bluetooth® 5.2 (*Bluetooth® version may change with OS version different.) -RangeBoost

Battery
90WHrs, 4S1P, 4-cell Li-ion

Power Supply
ø6.0; 240W AC Adaptor; Output: 20V DC, 12A, 240W; Input: 100~240C AC 50/60Hz universal AURA SYNC Yes Device Lighting Aura Sync Light Bar

Weight
2.90 Kg (6.39 lbs)

So I basically need to do stable diffusion or VQGAN + CLIP off a colab type workbook, but x5 sessions at once ideally, sending initial image and text, plus target image, to create a 30 second video. and ideally want it to run off hotspot not wifi. probably not possible?

will you have the admin permissions to sideload linux on it?
you can run jupyter locally and that should work fine, you won't need any internet

 

[catalog]

will you have the admin permissions to sideload linux on it?

i probably will, but i sadly don't know linux well enough to try doing that...

you can run jupyter locally and that should work fine, you won't need any internet

i'll look to see for a tutorial on this.

but i don;t get it - how do you get access to those HPCs and runtimes if you are not online?

 

[catalog]

this might be the next big thing:

high resolution video synthesis with latent diffusion

looks good actually. i need a bit longer than 4 seconds but 15 would do it. doesn't seem to be available to try yet though

 

[wektor]

i probably will, but i sadly don't know linux well enough to try doing that...


i'll look to see for a tutorial on this.

but i don;t get it - how do you get access to those HPCs and runtimes if you are not online?

oh I mean if you have a good GPU on your computer you just run things locally

 

[catalog]

And that spec of pc can do that right?

 

[wektor]

And that spec of pc can do that right?

I guess 8GB of VRAM should be enough to do something

 

[wektor]

pretty cool, you can run gpt-like models locally now (more than a few choices in there)
easy finetuning for further personalization is inevitably coming soon

https://gpt4all.io/index.html

 

[Clinamenic]

@wektor have you been using VQGAN+CLIP lately? I'm running into some errors when I try to run it on the few colab notebooks I usually cycle between, and I'm wondering if there were any updates or anything.

 

[Clinamenic]

Actually I think i just figured it out, from some stackoverflow thread. Looks like some package was renamed and there was an instance where the old name was used in the source code, and I just switched it to the new name. Seems to be working now!

 

[HMGovt’s Glorious Return!]

New trompe l'oeil meta facilitated by recent generative upgrades that allow working with text and overlays

https://x.com/daniel_eckler/status/1705202342159884742

(squint)

 

[wektor]

View attachment 16230

really pleasant to look at

 

[HMGovt’s Glorious Return!]

It has a name now, and a pretty good one: Controllism.