Heat a pot over medium heat. Once hot, add the oil, onion, and celery, Saute until the onions and celery turn translucent. Add in the garlic and saute until golden brown. Crumble in the sausage and brown while crumbling into smaller pieces until no longer pink.
Pour in the broth, thyme, beans, lemon, and season with salt and pepper, cover with a lid and bring to a simmer.
Add the orzo, cover with a lid and return to a simmer. Simmer until the orzo is tender, stirring occasionally, (refer to the instructions on the package for cooking time).
Taste and adjust the seasoning with salt or more lemon if needed. Remove the thyme sprigs. Garnish with parsley. Serve with crackers.