That being said / That having been said

Sometimes, we get to hear this phrase in many situations.

I love apples. That being said, I almost never eat them.

= I love apples. Even though I said that, I almost never eat them.

That being said (or that having been said) is used as a transition from something you have just said to something different, often something that contradicts the first thing. It is close in meaning to however.