It really depends on the technology.  The voltage follower will operate the fastest of any feedback circuit because it has the lowest gain (and therefore the largest feedback factor).  It is possible to design a follower without an op amp if you have the headroom, this may be faster.  Also, if you have a current mode DAC you can try loading it with a resistor.  This is probably the highest speed you can do in a given technology.