you can, but hopefully you have cut up your chicken beforehand and frozen the bite-sized pieces! otherwise, it may be very difficult to cut a frozen chicken breast into bite-sized pieces. if you're starting to bake your chicken and broccoli from frozen, understand that you will need to double the baking time for each.