Go to the float settings by right clicking on the box that says "float: Figure" and selecting "settings", as shown here:
Then unclick "Use default placement" and select the option that you want.
Also note that floats are expected to float. It is an advantage. consider reading the LyX manuals in the Help menu to learn more.