Day 16

Joe went over everyone’s presentation outlines today (except Jocelyn and Hannah’s, which we'll see tomorrow).

I started off the day trying to solve the problem I had Friday. I printed out all the tensor sizes and figured out where the error was occurring and why (the encoder and decoder aren’t symmetrical). It has something to do with the U-Net structure and the skip connections, but I’m still not sure of the cause so I've been experimenting with different parts of the code to see if I can get them to line up. I also made my generator code more uniform and used the same kernel-size, stride, and padding throughout, which should help as well.

Besides that, I worked more on the training and testing code. I'm currently running the training code on a similar model to see if it works, and so far it seems fine, although it makes the computer screen freeze every minute. I moved over to the computer next to it but the GPU is too old for Pytorch, so I decided to write this blog post and work on my presentation. I hope the training finishes soon so I can get some feedback and work on the other parts of the code, but I can always work more on my model tomorrow.

Comments

Post a Comment

Popular posts from this blog

Day 30 (Last Day!!)

It's hard to believe it's over. This morning we had our presentations in the auditorium, and everyone did really well. I remembered pretty much everything I wanted to say, and I think I explained my topic thoroughly. The presentations ended at almost exactly 11, and after closing remarks, photographs, and conversations, I stayed behind at RIT for a while and sent my files with the final code to my advisors. At noon my lab (which also includes two other graduate students) went out to lunch to celebrate, which was really nice because we ended up talking a lot (and not about debugging!) and I got to know them better. It's a little bittersweet because now my involvement is over, but it was a really rewarding experience and I learned how to do something new (many things actually). Overall, although it was stressful at times, I'm glad I ended up having so much autonomy with my project because it really taught me a lot about myself and about making mistakes. I'm going
Read more

Problem Statement

Amy Ruan Problem Statement           Image-to-image translation is a widely applicable area of computer vision; with it, street scenes can be generated from label maps, color pictures from grayscale ones, full objects from outlines, and photographic images from paintings. In short, image-to-image translation is the transformation of one type of scene representation into another. The development of generative adversarial networks (GANs) has facilitated this process, since its structure composes of two networks- the generator and the discriminator- that are trained to compete against each other until the generator has learned to mimic the data it was trained on, which results in clear and realistic output images in image-to-image translation.           Image-to-image translation and GANs have the potential to solve many problems. Autonomous vehicles, for example, must be able to perceive their surroundings even in the dark. While methods exist that translate nighttime photographs into RG
Read more

Day 28

I tested the model from yesterday and it looks surprisingly similar to the best one- the color of the sky is a little split between pink and blue but is blended in most of the images, and overall the objects look a little sharper. The graphs for the loss don’t make that much sense though, and the PSNR for the RGB images fluctuates a lot. This morning we ran through our presentations in the auditorium. We started at 9 am and didn’t finish until 11:50, but we had a lot of time in between each one for feedback. Mine was second and went 16 minutes (better time than I thought) and I got a lot of good advice too. Sometimes I forget that other people haven’t seen my presentation/topic before so I have to remember to explain/define everything. At lunch Jocelyn, Hannah, and I went out to eat and then to Abbott's. We also saw a beaver by the RIT entrance!  In the afternoon I worked on my presentation some more- I cut out some of the graphs as Joe suggested and also made the diagrams clear
Read more