Day 2

Today we started our routine- first we had a morning meeting (and got our prizes from yesterday’s video), and then we split up to each of our labs for the rest of the day. I got four more papers today- they were all about image-to-image translation, which is an application of generative adversarial networks. Reading them made the topic make a lot more sense and it’s really interesting. A couple examples of image-to-image translation: turning a painting of a landscape into a photograph, turning an outline into an entire picture, turning a daytime scene into a nighttime one, and even turning a horse into a zebra.

Besides the main article about image-to-image translation with conditional adversarial networks, there was one about using cycle-consistency loss and unpaired data, one focused on translating artwork by using patches and memory banks, and one on using multimodal image-to-image translation to get several different but still realistic outputs. I have to write a short summary paper about them (an introduction, a description of the architecture, and some related works)- I mostly finished the introduction today, and hopefully I'll finish the rest tomorrow. 

Overall, it was another good day. 

Comments

Post a Comment

Popular posts from this blog

Day 30 (Last Day!!)

It's hard to believe it's over. This morning we had our presentations in the auditorium, and everyone did really well. I remembered pretty much everything I wanted to say, and I think I explained my topic thoroughly. The presentations ended at almost exactly 11, and after closing remarks, photographs, and conversations, I stayed behind at RIT for a while and sent my files with the final code to my advisors. At noon my lab (which also includes two other graduate students) went out to lunch to celebrate, which was really nice because we ended up talking a lot (and not about debugging!) and I got to know them better. It's a little bittersweet because now my involvement is over, but it was a really rewarding experience and I learned how to do something new (many things actually). Overall, although it was stressful at times, I'm glad I ended up having so much autonomy with my project because it really taught me a lot about myself and about making mistakes. I'm going
Read more

Problem Statement

Amy Ruan Problem Statement           Image-to-image translation is a widely applicable area of computer vision; with it, street scenes can be generated from label maps, color pictures from grayscale ones, full objects from outlines, and photographic images from paintings. In short, image-to-image translation is the transformation of one type of scene representation into another. The development of generative adversarial networks (GANs) has facilitated this process, since its structure composes of two networks- the generator and the discriminator- that are trained to compete against each other until the generator has learned to mimic the data it was trained on, which results in clear and realistic output images in image-to-image translation.           Image-to-image translation and GANs have the potential to solve many problems. Autonomous vehicles, for example, must be able to perceive their surroundings even in the dark. While methods exist that translate nighttime photographs into RG
Read more

Day 28

I tested the model from yesterday and it looks surprisingly similar to the best one- the color of the sky is a little split between pink and blue but is blended in most of the images, and overall the objects look a little sharper. The graphs for the loss don’t make that much sense though, and the PSNR for the RGB images fluctuates a lot. This morning we ran through our presentations in the auditorium. We started at 9 am and didn’t finish until 11:50, but we had a lot of time in between each one for feedback. Mine was second and went 16 minutes (better time than I thought) and I got a lot of good advice too. Sometimes I forget that other people haven’t seen my presentation/topic before so I have to remember to explain/define everything. At lunch Jocelyn, Hannah, and I went out to eat and then to Abbott's. We also saw a beaver by the RIT entrance!  In the afternoon I worked on my presentation some more- I cut out some of the graphs as Joe suggested and also made the diagrams clear
Read more