2 ways to deal with it.
1, swage your pipe out a little so that it fits snuggly, or
2, just fill in the gap with cupro brazing rod when you braze the joint