Camellia Freedom Bell

I have had this plant for just over a year and brought it into the conservatory from outside about a month ago. However I think this has been a mistake as each bloom falls off almost as soon as it has opened. I don't think the plant is going to look like it did last year. However I popped this bloom back on its little holding stalk and set up a leaf-patterned cushion as a backdrop. I'm going to put the plant outside again and hope it will recover. Help! Any other ideas?