Cementing/Sealing/"Gluing" Pipe in Asphalt

I will be installing a drop down bar on a gate over an asphalt driveway. There is about a 1.5" hole in the asphalt where it will go. My idea was to install 3/4' pvc pipe (for the bar to drop into and protect the asphalt edge) and cement/glue/seal (???) it in with the material to take up the gap between the pipe and the asphalt. The asphalt hole is not a clean smooth hole (jagged/chunky).

What would be the best material to use. I was initially thinking just asphalt sealer (from a caulking gun) but I think it would get too soft during the summer and the pipe would smooch around as the wind hits the gate. Construction adhesive seem to adhere to most things, not sure about oily asphalt.

Thanks.

 

I would probably use an epoxy, like Ramset A7, or similar.

 

Id use Sika self leveling urethane crack filler.