Unfortunately, you cannot adjust the font size directly, but you can adjust the scale.
Try this expression on your text layer’s scale:
y=thisLayer.sourceRectAtTime().height;
s = linear(y,450,1000,55,75);
[s,s]
y is the height of the text layer.
linear is AE’s range mapper expression. 450 is the lower threshold, 1000 the top and then 55 and 75 are the percentages to output. Between 450 and 1000 the scale will be somewhere inbetween 55 and 75.
[s,s] puts the same scale value for the width and height.