The effect that dietary cholesterol has on blood cholesterol is actually quite a small one because of the bodies ability to reduce the amount of cholesterol released into the blood in response to the amount of dietary cholesterol consumed. So if you consume relatively large amounts of cholesterol (not advised however), the body will adapt in order to reduce the amount of cholesterol synthesised internally. Problems arise when people regularly consume high levels of dietary cholesterol, similarly problems might occur if too little is consumed.
Getting the balance right in all walks of life is key to physical and social harmony…avoiding a nutritional component completely, unless you’re Coeliac (avoid gluten) or lactose intolerant (avoid lactose) for example is never advisable, you never know how important these things may be to your body.
Thomas, B & Bishop, J. (2007). Manual of dietetic practice. 4th Ed. Dietary Cholesterol. Kent: Blackwell Publishing.