The first video (skipped the second half); He unintentionally highlights an important difference when he dismisses anarchist libertarians in the beginning. But as far as a comparison between US Libertarians (a la the Libertarian Party) and conservatives goes, it's not bad. Again, it does ignore the minority of anarchists within the LP.
I do have issues with his issues with libertarian positions, but that's another issue.
The second video (skipped around a bit); Limited government can be libertarian. Intruding less on liberty is more libertarian. But she's pretty much right about the Republican Party. They promise small government, but what they really want is different big government.
Really, libertarian is an incredibly broad term. You have your LP libertarians, but you also have your anarcho-capitalists, mutualists, geolibertarians, anarcho-communists, anarcho-syndicalists... the list goes on and on. And as you can probably guess, there is significant disagreement between these various groups. (Of note; "left" anarchists reject the anarcho-capitalist claim to anarchy). Significant members of the various groups include Benjamin Tucker, Lysander Spooner, Murray Rothbard, Peter Kropotkin, Pierre-Joseph Proudhon, and many more.
I'll take anarcho-capitalism as an example of further differences. Ancaps typically come in two flavors. You have your "Rothbardians" (for Murray Rothbard) and your "Friedmanites" (for David Friedman, not his father, economist Milton Friedman). Rothbardians derive their views from the non-aggression principle (or axiom), whereas Friedmanites argue from a sort of consequentialist mindset.
As for how conservatives and libertarians are not the same... There is actually a thing called libertarian conservatism. That's what I'd call the people who wield the Constitution as the most important document for limiting government. Interestingly, people like Ludwig von Mises, Frederic Hayek, and Milton Friedman have been described as such. All three are very significant names within the Austrian and Chicago schools of economics, which in turn, are very significant in free market anarchy (specifically anarcho-capitalism). So, there is some overlap. But if you're talking about the Republican party, or neocons... they're just authoritarian.
For abortion; the answer you get from libertarians will vary depending on who you ask. Some are pro-choice, because they see restricting abortion as infringing on a woman's liberties. Some are pro-life because they see restricting abortion as infringing on the unborn child's liberties. Some are pro-choice because they believe that banning abortion will result in too many negative externalities. There are so many possibilities depending on the views of the person you ask, and none of them are really wrong, or "unlibertarian" ... you just have to know where they're coming from.