Avoid the pre-Legacy turbo cars! 3.7 gear ratio, AWD or a really pitiful low range, and a love for cracking heads, blowing head gaskets, overheating, and generally sucking. Not to mention that a SPFI (throttle body injection) EA82 made up to 95hp, while the MPFI turbo only made 120hp at it's peak, most years were 110-115.
My recommendation for a Subaru would be an 81-84 Wagon or 81-89 Hatch GL, dual range four speed and highly modifyable. 81-83 had a direct-ish 4th gear, and mechanical valve adjustments, 83 up had hydraulic lash adjusters and 4th was an overdrive. Those cars have the pushrod EA81 engine which is far more durable than the OHC EA82. All non-turbo EA81 and EA82 Subarus have a 3.9 axle ratio, turbos have 3.7 ratios, and while a 4.10 and 4.444 rear diff ratio are available, there is no way to swap the front ring and pinion due to the design of the transmission.
A common modification is to lift about 6", swap in a Nissan 720, Samurai, or Lada Niva transfer case behind the d/r four speed or a swapped in d/r five speed from an EA82 driving a flipped rear diff in the front and the standard rear diff. With this, a lot of people convert to six lugs and run 28-31" tires.