Hyperbolic balance laws have steady state solutions in which the flux gradients are nonzero but are exactly balanced by the source terms. In our earlier work [31–33], we designed high order well-balanced schemes to a class of hyperbolic systems with separable source terms. In this paper, we present a different approach to the same purpose: designing high order well-balanced finite volume weighted essentially non-oscillatory (WENO) schemes and RungeKutta discontinuous Galerkin (RKDG) finite element methods. We make the observation that the traditional RKDG methods are capable of maintaining certain steady states exactly, if a small modification on either the initial condition or the flux is provided. The computational cost to obtain such a well balanced RKDG method is basically the same as the traditional RKDG method. The same idea can be applied to the finite volume WENO schemes. We will first describe the algorithms and prove the well balanced property for the shallow water equations, and then show that the result can be generalized to a class of other balance laws. We perform extensive one and two dimensional simulations to verify the properties of these schemes such as the exact preservation of the balance laws for certain steady state solutions, the non-oscillatory property for general solutions with discontinuities, and the genuine high order accuracy in smooth regions.