Yes, it is indeed 'inside' you, but that's got nothing to do with the Bible. Quite the contrary.
The Bible often perverts what one's natural conscience and heart tells them is right versus wrong. Example, we naturally feel love for our relatives and want to talk to them, but the Watchtower says the Bible forbids talking to them if they leave the organisation. Example, a parent would never, ever, naturally make a decision that could result in the death of their child, yet the Watchtower preaches that the Bible says God requires that the parents must forbid a life-saving blood transfusion for their child. And there are many other examples of how the Bible actually corrupts and perverts one's natural moral sense of right and wrong.
People know what is right from wrong without a so-called 'holy' ancient book to tell them. Look at the Muslim militants totally ignoring their natural sense of moral right from wrong and beheading people and blowing themselves to kill others, all in the name of religion and their 'holy' book?
Even the Apostle Paul admitted in Romans 2 that people of the nations naturally distinguish right from wrong from the law that is written in the heart and conscience.
In order to understand this, you need to understand what the Bible really is: mostly a book of interesting Jewish historical records overlaid with fables and priestcraft.
Every single 'miracle' in the Bible is complete fiction, a mere fable. The sooner you accept this, the sooner you will be free.