After missing out on summer vacations because of high fuel prices and a weakening economy, many Americans won't be going anywhere over the Labor Day weekend either.