To create a library feature without references, create the library feature without dimensions or relations relative to the base part.
Instead of using references to position the library feature on the model, you edit the library feature sketch and position that sketch relative to the model.