Day 17

Today my advisors got a more detailed description of the error in the model code, which indicated that there was an issue with the size and crop of the images. After changing them to multiples of 256 (because of the way I defined the U-Net structure), it now works!

The next roadblock was the computer memory, which I guess can no longer handle running the code. I tried running my training code this morning with my model, but it was really slow and was killed by the time I got back from lunch and the master's thesis defense I went to. I ran it again, but even after two hours it was still on the first epoch, and eventually it also ended because the CPU didn’t have enough memory. I’m using the CPU because the GPU doesn’t have enough memory either (even less because other people might be using it) and the computer in the lab is still broken. I emailed my advisor though and I think we'll work out an alternative tomorrow. I also found out that training can take 2-3 days, which is longer than I thought.

Other than that I worked on the testing code. I’ll have to figure out how to print both the input and output images correctly but that shouldn’t be too difficult. 

The thesis defense I went to today was on different methods of detecting shadows in images using neural networks and other techniques. It was in the Gleason building, but the project had a lot of connections with imaging. 

Comments

Post a Comment

Popular posts from this blog

Day 30 (Last Day!!)

It's hard to believe it's over. This morning we had our presentations in the auditorium, and everyone did really well. I remembered pretty much everything I wanted to say, and I think I explained my topic thoroughly. The presentations ended at almost exactly 11, and after closing remarks, photographs, and conversations, I stayed behind at RIT for a while and sent my files with the final code to my advisors. At noon my lab (which also includes two other graduate students) went out to lunch to celebrate, which was really nice because we ended up talking a lot (and not about debugging!) and I got to know them better. It's a little bittersweet because now my involvement is over, but it was a really rewarding experience and I learned how to do something new (many things actually). Overall, although it was stressful at times, I'm glad I ended up having so much autonomy with my project because it really taught me a lot about myself and about making mistakes. I'm going
Read more

Problem Statement

Amy Ruan Problem Statement           Image-to-image translation is a widely applicable area of computer vision; with it, street scenes can be generated from label maps, color pictures from grayscale ones, full objects from outlines, and photographic images from paintings. In short, image-to-image translation is the transformation of one type of scene representation into another. The development of generative adversarial networks (GANs) has facilitated this process, since its structure composes of two networks- the generator and the discriminator- that are trained to compete against each other until the generator has learned to mimic the data it was trained on, which results in clear and realistic output images in image-to-image translation.           Image-to-image translation and GANs have the potential to solve many problems. Autonomous vehicles, for example, must be able to perceive their surroundings even in the dark. While methods exist that translate nighttime photographs into RG
Read more

Day 28

I tested the model from yesterday and it looks surprisingly similar to the best one- the color of the sky is a little split between pink and blue but is blended in most of the images, and overall the objects look a little sharper. The graphs for the loss don’t make that much sense though, and the PSNR for the RGB images fluctuates a lot. This morning we ran through our presentations in the auditorium. We started at 9 am and didn’t finish until 11:50, but we had a lot of time in between each one for feedback. Mine was second and went 16 minutes (better time than I thought) and I got a lot of good advice too. Sometimes I forget that other people haven’t seen my presentation/topic before so I have to remember to explain/define everything. At lunch Jocelyn, Hannah, and I went out to eat and then to Abbott's. We also saw a beaver by the RIT entrance!  In the afternoon I worked on my presentation some more- I cut out some of the graphs as Joe suggested and also made the diagrams clear
Read more