Paper Wasp Nest

I saw this just the other day, and it appeared that it arrived overnight. I don't think the nest could have been built that quickly but I was amazed to find it there, attached to branch of my favorite tree. Unfortunately, the nest is only about 4 feet above the ground, and the wasps were arriving and departing right toward the driveway and the front porch. These are paper wasps, and not the agressive yellow jackets, but I was worried about people getting stung by them. It was a very busy nest. So... I bought the special wasp spray, and went out at midnight with a flashlight and the spray, and soaked the nest completely. There is now no activity and I will cut the nest down tomorrow. Here is the bad part - I looked up these wasps and discovered that they are really beneficial insects, and they recommend that you leave them alone, unless they are close to where people are. So now I feel really badly.