https://stackoverflow.com/questions/4880286/is-a-markov-chain-the-same-as-a-finite-state-machine#:~:text=Whilst%20a%20Markov%20chain%20is,random%2C%20and%20described%20by%20probabilities.

Dear Mihir Malladi

Yes whilst a Markov chain is a finite state machine, it is distinguished by its transitions being stochastic, i.e. random, and described by probabilities.

you can learn more about here:

https://www.khanacademy.org/computing/computer-science/informationtheory/moderninfotheory/v/markov_chains

Kind Regards

Qamar Ul Islam