The Home of Dementia - AI Art and Human Experiences [en/spa]

in Alien Art Hivelast year (edited)

dementia_4.png


The home of the dementia is inside us and outside us at the same time. It’s as if we were being watched over by the house all the time and that the house has it’s own memory. But is not that, the house is us, and we are just nuts!.

El hogar de la demencia esta dentro nuestro y también fuera, al mismo tiempo. Como si estuviéramos siendo observados todo el tiempo por la casa y como si tuviera sus propia memoria. Pero no se trata de eso, la casa somos nosotros, y nosotros, ¡estamos locos!





AI Art Experiences



Usually I write here my adventures with my AI, and sometimes, do creative writing. Today I come with something different, that I guess gonna please the other people around who is playing with VQGAN AI's.

I'm always looking for new tools to improve my AI artworks. In fact, not only tools, but articles about this AI, and also I look for another artworks made with VQGAN, and whatever thing related to this topic. There are tens of Google Colab Notebooks around, many are just modifications of another ones. Along this month I have found some very interesting, many were broken, sadly. But I have been fixing these little bugs in many of them, and adding some features from ones to the the others. It still a work in progress, but now they are totally functional, and I'm gonna share them with all of you.

There are four notebooks:

  1. Enhanced Original VQGAN+CLIP Notebook

  2. Mse regularized Modified VQGAN+CLIP Notebook

  3. VQGAN+CLIP with Video Features Notebook

  4. Real ESRGAN 4x Notebook


The first notebook, is the original one with some extra features. Custom directories, custom connection to Google Drive, some anti-disconnect features, and a clean finish that makes easy to use it.

About the second one, is a versión of the first one that gives more detailed, and cohesive results. What it does, to explain it in a simple way, is to decrease gradually the amount of randomness in each iteration. In around 200 iterations, the randomness becomes almost inexistent. This is good because as you know, with the regular notebooks (like the first one), the AI is in a rush to transform things. So many times, the AI ruins stuff we already liked, so we usually have to stop at 200-500 iterations. With this Notebook, you don't have to worry anymore, the stuff you got at the beginning gonna be preserved, and you can let it run thousands of iterations to get most detail as possible. In the other hand, you should consider the bad side of this. You're are cutting out the AI wings, as it is not gonna bring new things after 250 iterations. It still a WIP, and I would like to add several stuff, for example, a proper prompting menu.

The third one, gonna make happy many people around. At least, Castleberry for sure, as we have mentioned how cool would be get fixed this notebook. So it was no longer working but after fix some stuff is up again. You can make videos with zoom, rotation, and translation. I'd would like to make some improvements to it in a future.

And the last one, is an awesome upscaling AI. It gonna scale your images at four times its original size. You should consider that depending of which GPU you have got, it might run out of memory. It worked fine upscaling images from 500x500 pixels to 2000x2000. Higher than that, I ran out of memory.

And that's all for today, I'm about to mention everybody that have seen around playing with VQGAN, at the bottom of this section.

Normalmente escribo acerca de mis aventuras con mi IA, y a veces hago un poco de prosa. Pero hoy traigo algo distinto, que creo que va a complacer a la otra gente que veo por aquí jugando con VQGAN IA's.

Siempre estoy buscando nuevas herramientas para mejorar las obras que hago con la IA. De hecho, no sólo miro herramientas, también artículos acerca de esta IA, otras obras hechas con VQGAN, y cualquier cosa relacionada con este tema. Hay decenas de Google Colab Notebooks, y muchos son modificaciones de otros. A lo largo de este mes, he encontrado bastantes que son interesantes, pero la mayoría no funcionaban apropiadamente, o ni iban. Así que me he dedicado a ir arreglando estos pequeños fallos, y añadiendo algunas funcionalidades de unos a otros. Siguen quedando cosas que añadir y arreglar, pero ya son totalmente funcionales, y quiero compartirlos con todos vosotros.

Hay cuatro notebooks:

  1. Enhanced Original VQGAN+CLIP Notebook

  2. Mse regularized Modified VQGAN+CLIP Notebook

  3. VQGAN+CLIP with Video Features Notebook

  4. Real ESRGAN 4x Notebook


El primero, es el original con algunas funciones extra. Posibilidad de conectarse a Google Drive, directorios al gusto, una funcionalidad para evitar desconexiones, y un acabado limpio que hace más fácil usarlo.

Acerca del segundo, es una versión del primero que ofrece resultados mas detallados y cohesivos. Explicado de una forma simple, lo que hace es reducir progresivamente la aleatoriedad en cada iteración. En unas 200 iteraciones, la aleatoriedad es casi inexistente. Esto es bueno, por que como ya sabéis, con el típico notebook (como el primero), la IA está ansiosa de transformar cosas. Así que, a menudo" la IA estropea cosas que nos han gustado, y normalmente necesitamos pararla entre 200 y 500 iteraciones. Con este Notebook, se acabó preocuparse por ello, la imagen que se ha estado formando al principio, ya no cambiara de forma sustancial, así que puedes dejarla "cocinándose" miles de iteraciones para conseguir el máximo de detalle. De todas formas, hay que considerar el lado negativo de todo esto. Le estás cortando las alas, y no te traerá nada nuevo después de unas 250 iteraciones. Este notebook está todavía en proceso de construcción, y me gustaría añadirle unas cuantas cosas más, por ejemplo, un menú decente para el prompt.

El tercero hará feliz a bastante gente, creo. Al menos a Castleberry, ya que hemos mencionado alguna vez lo bueno que estaría conseguir reparar este notebook. No funcionaba pero después de algunos arreglos ya está en marcha otra vez. Se pueden hacer videos con zoom, rotación y translación. Me gustaría hacerle unas cuentas mejoras en un futuro.

Para acabar, el último es una IA para escalado que me ha dado buen resultado. Escala imágenes a cuatro veces su tamaño. Hay que tener en cuenta que, dependiendo de la GPU que te hayan asignado, podrías quedarte corto de memoria en la máquina. Me ha funcionado bien escalando imágenes de 500x500 pixels a 2000x2000. Con imágenes más grandes que estas, me quedé sin memoria y no fue posible escalarlas.

Y aquí acabo por hoy, voy a mencionar a todo el mundo que he visto jugando con VQGAN por aquí.


cc: @castleberry, @nikv, @dbddv01, @eve66, @lavista, and maybe @kitzune is interested as well.





AI Artworks



dementia _1.png


dementia_2.png


dementia_6.png


dementia_4.png


dementia_5.png


dementia_3.png





All the content of this post is from my own.
Todo el contenido de este post es de mi autoría.

Images generated with VQGAN+CLIP and edited with Photoshop.
Imágenes generadas VQGAN+CLIP y editadas con Photoshop.

100% AI free writing.
Textos 100% libres de IA.

Sort:  

Hi @jotakrevs . Thank you so much for the mention and the modified notebooks :), this is literally treasure!
This is some fantastic stuff that you are doing and your work is improving by leaps and bounds. Great going, keep going man. I really don’t know where this can end up!

I'm, very glad you liked the notebooks, and hope they become useful for your artworks! Thanks a lot for your kind comment, and grab this yummy slice of !PIZZA!

@lavista! I sent you a slice of $PIZZA on behalf of @jotakrevs.

Learn more about $PIZZA Token at hive.pizza (2/10)

They will be very useful, I am already using the second one! thank you again !

Yay! I hope you enjoy it, the results are more clean and detailed!

Yes truly. 👍

And regarding upscaling, I had used this website :https://bigjpg.com/
recently and seemed to do a pretty decent job. Do check it out if you have not already.

Thank you! I already used this webpage some weeks ago... sadly, after upscale 20 images (more or less) they told me that I already used the max amount of monthly requests... so had started to look for another options, and have found the upscaling notebook I'm sharing in my post. Regards!

Ah, I see. thanks for this notebook :)

Yeah, I think there is a paid service without limit of use... but I already pay for Google Colab so I try to manage everything there. Regards!

Yes, best to make use of one service when you are already paying for it.

yeah 👍

Hola @jotakrevs, super post ! I will give a try to your modified notebooks for sure. Thx for the mention.
A question : Assuming you get a colab pro from spanish IP, did you get any roadblock to get access or did you had to fake your country ? I did not try as my country is not listed...
Hi, @lavista
A note for esrgan, there is a slow free usable demo at https://huggingface.co/spaces/akhaliq/Real-ESRGAN. Can be useful when you're out of quota on colab.

Hi @dbddv01 ,
How are you?
Thanks a lot for the link :)

Hi Lavista, well i'm fine and discovering your cool artwork.

Hope the notebooks are useful for you, I'm glad you liked them!

A question : Assuming you get a colab pro from spanish IP, did you get any roadblock to get access or did you had to fake your country ? I did not try as my country is not listed...

I just faced that issue. Colab pro is only available in USA, so when you try to get a pro account, it asks for an USA zip code. But that's all, they don't ask for anything else, you just need to put there a USA ZIP code. They don't seem to be checking IP's although it may happen eventually... Hope they leave me in peace lol

From this stackoverflow post:

If you really want to, you can. If you input a zip in the US it will allow you to buy it, but with TAX.

If you choose 03222 or 97222, there will be no tax charged.

Beware: This is against the agreement that you will not pretend to be in the US. So, do it at your own risk. They might terminate your subscription any day.

About Colab quota, for both free and pro users, is a quota based in google accounts, nor IP's. What I was doing before get pro version, was just to switch to other Google account, when I ran out of usage time. With 2 accounts one can cover almost all the day (unless you never sleep).

But is good to know that there is a webpage offering Real-ESRGAN. Lol is the same of Dall-e, but never noticed until you linked it in your comment.

Regards and grab your !PIZZA!

@dbddv01! I sent you a slice of $PIZZA on behalf of @jotakrevs.

Learn more about $PIZZA Token at hive.pizza (9/10)

Cool. thx for dedicated answer. I also use the "two accounts" trick for extended time ;-) but getting a decent gpu is the main driver to get the Colab pro. Will think definetely think about it.

Get pro is a very substancial change, I think the 10$ month account is worthy. After they got ride of the thousand of bots, now I'm getting again T4 and sometimes P100 GPU.

Cheers!

A lot more went into this post than most realize. Those notebooks are invaluable for anyone interesting in giving this all a go. Thanks a bunch for your efforts and experiments! Keep up the great work. Thanks for sharing with the community! =)

Thanks a lot for your kind words and the support as well! I really would like to see people doing awesome artworks, this technology can be pushed far forward that could seems, that's why I'm putting a lot of effort to fix these tools and share them. I try to make it easy for everybody. Hope you enjoy the notebook for video tripping!

Thanks again and don't forget your !PIZZA!

@castleberry! I sent you a slice of $PIZZA on behalf of @jotakrevs.

Learn more about $PIZZA Token at hive.pizza (3/10)

Hey buddy! I have been out of pocket the last couple of days leaving Sweden and coming back to Texas. I am just now about to play around with one of the notebooks and wanted to say thanks again.

I made a couple of posts about an analogue artwork i did while listening to a music album that was designed to simulate the stages of dementia. Here is one of the posts with some of the links to the music and my original post explaining my methods and thought processes. I thought it was interesting we both touched on the subject in a creative way. Here is the link
https://peakd.com/hive-158694/@castleberry/art-abstractions

Cheers bro!

Oh, I liked a lot your artworks in the post. You have meda me remind, that liked to do that stuff when was a kid. Now I'm tempted to fry my brains figuring how to request to the AI something like this haha

You made an interesting experiment there... I heard the music you used for a while and... it sounds like a diluted pieces of memories, unbonded of each others... yeah, it evoques the dementia, and gives another layer of sense to these artworks.

Wow, long trip by the way. Hope you enjoy the notebooks!

Regards and don't forget your !PIIZA dude!

Thanks bro! I appreciate you taking time to check that out. Yes, the music gets less and less musical as it progresses. To be honest, i couldn't listen to it all in one sitting and i felt disturbed by the experience for a couple of days. hahaha

I had a few issues with the notebooks not working for me but i am going to give it a try again today. Thanks for all your efforts and contributions man. I think you should get back into art if you were liking it as a kid. I think all people are artists until at some point in their lives they decide they aren't good enough and then usually give it up. I say.... never grow up and stay childlike in the creative areas of life. Take care and have a great Friday. =)

Lol, I felt disturbed after half hour of the music, so I can feel your pain hehe.

And yeah, I'm coming back to arts with the AIs, always thought that would be awesome to be able to create telling it. And it happened (:

I had a few issues with the notebooks not working for me but i am going to give it a try again today.

Uhm I had a mess with the notebooks and the damn Google Colab, yesterday. Maybe are you using the old links? The notebooks got destroyed, I told what happened it in yesterday post. These are the proper links, just in case.

Enhanced Original VQGAN+CLIP Notebook

Mse regularized Modified VQGAN+CLIP Notebook

VQGAN+CLIP with Video Features Notebook

Real ESRGAN 4x Notebook

Take care and have a good Friday too!

Yes, i didn't want to bug you. I used the links from your newest post with the rant. I could imagine how frustrating all that could be after you put all the time, effort, and work into it.

I would get everything going but it seemed that one of the pathways was missing. I don't remember which one for which one. 3 out of 4 notebooks didn't work for me... but the Enhanced Original worked fine. So i played with that one last night.

Sometimes, i feel like it's an easy fix... i just don't know how myself. I don't like depending on folks for the little things. I would like to learn enough to fix my own minor problems when they occur. Eventualy, we will all get there.

Here was a tutorial post i came across from Kaliyuga that you might be interested in.
https://peakd.com/hive-158694/@kaliyuga/using-runwayml-to-train-your-own-ai-image-models-without-a-single-line-of-code

I think i am going to play around with that one later... and when i try your notebooks i will write down my error codes to run by you sometime when you aren't busy and you are in the mood to check 'em out.
Cheers =)

 last year (edited) 

Thanks for the mention and the resources, the results just keep getting better and better.
This one is a zombie buffet hehe

You're welcome! All these tools are helping to improve my results, that's why I'm sharing them. Hope to see more amazing artworks!

Take this !PIZZA! And don't worry, is not made of zombie stuff!

@nikv! I sent you a slice of $PIZZA on behalf of @jotakrevs.

Learn more about $PIZZA Token at hive.pizza (4/10)

Thank you! 🍕should never have 🧠

Nope that would be gross lol

Sausage is best 😉

But not a zombie one!

WoW!! So Trippy hehe!!

The home of the dementia is inside us and outside us at the same time. It’s as if we were being watched over by the house all the time and that the house has it’s own memory. But is not that, the house is us, and we are just nuts!

Agree!! :)

!discovery 36
!PIZZA

@jotakrevs! I sent you a slice of $PIZZA on behalf of @lallo.

Learn more about $PIZZA Token at hive.pizza (2/10)

I'm glad you liked it, thanks for the support! Take this !PIZZA from a nuts to another lol

Regards!

@lallo! I sent you a slice of $PIZZA on behalf of @jotakrevs.

Learn more about $PIZZA Token at hive.pizza (5/10)


This post was shared and voted inside the discord by the curators team of discovery-it
Join our community! hive-193212
Discovery-it is also a Witness, vote for us here
Delegate to us for passive income. Check our 80% fee-back Program

Un trabajo impecable,lleno de dedicación y ardua creatividad. Es como ver una galería abstracta de zombies, con una naturaleza rapaz y violenta. Tu trabajo es espectacular, sigue así para mejorarlo. ¡Saludos! @jotakrevs

PD: Te invito a usar la etiqueta #creativecoin en tus publicaciones, para que ganes recompensas en CCC con nuestro voto.

Tu post ha sido votado por @celf.magazine, proyecto curatorial y revista digital sobre arte y cultura en Hive. Únete a nuestra comunidad y comparte tu talento con nosotros.
Your post has been voted by @celf.magazine, curatorial project and digital magazine about art and culture in Hive. Join our community and share your talent with us.



Muchas gracias por tan amable comentario, y por supuesto, el apoyo a mi publicación. Ojalá las herramientas que he compartido ayuden todos lo que se dedican a experimentar con la inteligencia artificial enfocada a las artes.

Saludos y tomad esta !PIZZA!

@celf.magazine! I sent you a slice of $PIZZA on behalf of @jotakrevs.

Learn more about $PIZZA Token at hive.pizza (6/10)

Gracias por la recomendación! 😮 Aún estoy en proceso de entenderlo. Hasta ahora solo he generado algunas imágenes acá: https://www.artbreeder.com/browse
Aunque creo que el método es diferente al que mencionas. Perdona si estoy diciendo algo incorrecto ¿? 🙂

Tanto VQGAN+CLIP, como Artbreeder, se basan en el mismo tipo de tecnología, pero a la hora de usarlos son muy distintos. Espero que si algún día te animas con VQGAN+CLIP, mis publicaciones sean de ayuda.

Saludos y no olvides tu !PIZZA!

@kitzune! I sent you a slice of $PIZZA on behalf of @jotakrevs.

Learn more about $PIZZA Token at hive.pizza (7/10)

Gracias! Seguramente estaré posteando más adelante los resultados que sean buenos :)

This is a fabulous post. I’ve been using VQGAN+Clip since July, and I’m really excited to try out a couple of those notebooks that are new to me :)

Cool, hope you will have fun with them! Grab this !PIZZA by the way!

@kaliyuga! I sent you a slice of $PIZZA on behalf of @jotakrevs.

Learn more about $PIZZA Token at hive.pizza (2/10)

this is awesome

Thank you! Grab this slice of !PIZZA!

thanks!

@delcarmat! I sent you a slice of $PIZZA on behalf of @jotakrevs.

Learn more about $PIZZA Token at hive.pizza (5/10)

Hola, de los cuadernos que publicastes, los voy a revizar pero me encuentro con una advertencia que no se puede utilizar para fines comerciales.

que no pasa con el cuaderno que uso actualmente, o no esta definido.

Real ESRGAN 4x si lo he usado.
Soy usuario gratuito, antes me asignaban un dia si y otro no un GPU de 15, pero ahora es casi imposible.
Me gustaria ser Pro, pero soy de venezuela y no poseo tarjeta de credito, seria excelente que aceptaran Crptomonedas para el pago.

Ademas segun lei en las publicaciones, la opcion Pro no estaria abierta para mi pais.

Mira, esto de la advertencia lo han borrado en muchos notebooks, pero es que hay datasets comerciales y otros que no. Cada cual es responsable de lo que quiera hacer, pero me pareció mal borrar esa información. De todas formas dudo mucho que Google ande mirando que hace la gente.

Uf ya, se ha puesto difícil conseguir GPU's decentes, por eso acabé pagando. En cuanto al problema de la falta de tarjeta de débito/crédito, no se si Google acepta tarjetas de cryptomonedas como la de Binance y algunas otras.

La opción Pro tampoco está en mi país, pero para contratarlo sólo piden el numero de la tarjeta y un Código Postal de USA, no piden nada más y te dan de alta. Lo único que si algún descubren que no eres de USA te cierran la cuenta. Dudo que comprueben estas cosas.

Toma tu !PIZZA!

@eve66! I sent you a slice of $PIZZA on behalf of @jotakrevs.

Learn more about $PIZZA Token at hive.pizza (8/10)

Wow I think you really nailed the perception of dementia there and such a great way to create more awareness of this debilitating and sad topic too!

@lavista just introduced me to your work today and I am so thankful to both of you that I get to check out your notebooks so I can learn as I haven't been motivated to do anything creative over the past few months, but that is all about to change because of you guys!

So thank you both once again!!!

Oh wow, I'm happy that we brought back your motivation do be creative again! Hope the notebooks will help you, I'm trying to compile useful tools to work with AI art, and making the experience most confortable as possible as well.

The dementia... to be honest, the AI nailed it more than me. The result was far better than I expected hehe

Regards, have fun and grab this slice of !PIZZA, is for you!

@chocolatescorpi! I sent you a slice of $PIZZA on behalf of @jotakrevs.

Learn more about $PIZZA Token at hive.pizza (3/10)

Yeah me too- THANKYOU, but I think I'm just going to start of slowly with artbreeder and then progress onto Enhanced Original VQGAN+CLIP and even blender....I am a video editor and photoshopper, but that really about it and I'm a very straight cut editor because of the type of material that I am editing, no Hollywood Michael Bay stuff, just straight up documentary stuff with no bells and whistles so as not to detract from the seriousness of the topics....but I've always wanted to learn to be way more digitally creative, just had no time and lately not much motivation, until now! 😊

This is my professional website, all of the footage is getting old...https://www.chocolatescorpion.com/projects and this is my 'hobby' website https://chocolatescorpionc.wixsite.com/chocolatescorpi

Sounds like a good plan, step by step. After try the Enhanced I'll suggest you give a try to the MSE one. They are very similar but the MSE provides finer results in my opinion. Have fun in this trip!

By the way, visits your sites has been a trip as well!

So much to learn, so little time, so not enough hands/fingers...🤣 (I have enough computers...) but there's only on of me...🤣

But thank you, I am checking it all out now. 😁

Not sure if you noticed, but I took last night off peakd and watched heaps of tuts on artbreeder, blender and refreshers into sweet home 3d to and started recreating my dream home in sweet home 3d (since I have no idea where I saved the original designs a decade ago from it...I thought it would be easier and faster to recreate it than to try to find it..)

Glad you liked my stuff, see I am creative, just not as technically advanced with my skills as most people...

That's cool, hope you gonna show us the house when it's finished!
Take some more !PIZZA!

Absolutely!

And live in it- in my head...lol...

You are most welcome! We are really looking forward to your creative expressions now :)

Haaa thank you, so many seeds have been planted, are now being nurtured and will grow into something very soon!

I also downloaded Blender last night to cause there's a few things on there that I have always wanted to learn to create aswell...but then I got hung up on having a huge refresher into sweet home 3d...and had a night of peakd...having too much fun on sh3d! 🤣

Have fun with everything I suppose :)

Oh and I will cause you guys have really motivated me to! 😃

PIZZA!
PIZZA Holders sent $PIZZA tips in this post's comments:
@jotakrevs(4/10) tipped @chocolatescorpi (x1)
Learn more at https://hive.pizza.