With the development of smart grid, physical power system has been coupled with cyber and communication system deeper and deeper. Attacks against the cyber and communication system such as False Data Injection (FDI) may cause fatal influences on the security and stability of power system, researches about it has become hot topics at present. One successful FDI attack has to take resources owed by an attacker, the selection of attack area and the building of attack vector into consideration. With limited resources, the single-node and the multi-node attack areas are built around the attacked nodes according to the operation characteristics of the real power system, which can narrow the scale of an attack in some degree. Based on the nonlinear state estimation model, an attack cost analysis method is proposed with limited power system information for the single-node and the multi-node attacks. Lastly, IEEE-14 and IEEE-1354 power systems are applied for the effectiveness of the FDI attack cost analysis proposed by the paper in the situations of the single-node and the multi-node attacks. This work is supported by Science and Technology Project of State Grid Corporation of China “Identification Method of Malicious Attack on the Power Grid and Active Defense Method on the Power Grid Side” (No. 524608170138) and Project of Jiangsu Economic and Information Technology Commission “Research of Key Technologies and Platform Development of Cyber Physical Power System Co-Simulation” (No. 524608170191).