Bird help!!!!? Please!?

Hi I have a birds nest in my window box and I HATE IT! I'm a big gardener and it's in the way. Normally I'd just huck the nest in the woods but there's a dilemma. Theres some babies in it! How can I get the parents to leave? I have no problem with putting the babies somewhere but what should I NOT do to make sure the parents come back. Like what shouldn't I do? Like let's say if I touch them the parents won come back or something. Do you think it's possible I could keep them because I've rescued baby birds in the past but do you think I could keep them? If I can j don't want the parents bugging me so how can I make them forget abou the baby? Please answer EVERY question I ask. Even the ridicules ones...