Difference between revisions of "Modular arithmetic"

(started resources)
(Computation of Powers Mod n)
Line 98: Line 98:
 
We could (in theory) solve this problem by trying to compute <math>7^{1942}</math>, but this would be extremely time-consuming.  Moreover, it would give us much more information than we need.  Since we want only the tens and units digits of the number in question, it suffices to find the remainder when the number is divided by <math>100</math>.  In other words, all of the information we need can be found using arithmetic mod <math>100</math>.
 
We could (in theory) solve this problem by trying to compute <math>7^{1942}</math>, but this would be extremely time-consuming.  Moreover, it would give us much more information than we need.  Since we want only the tens and units digits of the number in question, it suffices to find the remainder when the number is divided by <math>100</math>.  In other words, all of the information we need can be found using arithmetic mod <math>100</math>.
  
By writing down the first few powers of <math>7</math>, we see that <math>7^4 = 2401 \equiv 1</math> (mod <math>100</math>).  So for any positive integer <math>k</math>, we have <math>7^{4k} = (7^4)^k \equiv 1^k \equiv 1</math> (mod <math>100</math>).  In particular, we can write
+
We begin by writing down the first few powers of <math>\overline{7}</math>:
 +
 
 +
<math>\overline{7}, \overline{49}, \overline{43}, \overline{1}, \overline{7}, \overline{49}, \overline{43}, \overline{1}, \ldots</math>
 +
 
 +
A pattern emerges!  We see that <math>7^4 = 2401 \equiv 1</math> (mod <math>100</math>).  So for any positive integer <math>k</math>, we have <math>7^{4k} = (7^4)^k \equiv 1^k \equiv 1</math> (mod <math>100</math>).  In particular, we can write
  
 
<math>7^{1940} = 7^{4 \cdot 485} \equiv 1</math> (mod <math>100</math>).
 
<math>7^{1940} = 7^{4 \cdot 485} \equiv 1</math> (mod <math>100</math>).
Line 107: Line 111:
  
 
Therefore, by the definition of congruence, <math>7^{1942}</math> differs from <math>49</math> by a multiple of <math>100</math>.  Since both integers are positive, this means that they share the same tens and units digits.  Those digits are <math>4</math> and <math>9</math>, respectively.
 
Therefore, by the definition of congruence, <math>7^{1942}</math> differs from <math>49</math> by a multiple of <math>100</math>.  Since both integers are positive, this means that they share the same tens and units digits.  Those digits are <math>4</math> and <math>9</math>, respectively.
 +
 +
==== A General Algorithm ====
 +
 +
In the example above, we were fortunate to find a power of <math>7</math> -- namely, <math>7^4</math> -- that is congruent to <math>1</math> mod <math>100</math>.  What if we aren't this lucky?  Suppose we want to solve the following problem:
 +
 +
''What are the tens and units digits of <math>13^{404}</math>?''
 +
 +
Again, we will solve this problem by computing <math>\overline{13}^{404}</math> modulo <math>100</math>.  The first few powers of <math>\overline{13}</math> are
 +
 +
<math>\overline{13}, \overline{69}, \overline{97}, \overline{61}, \overline{93}, \ldots</math>
 +
 +
This time, no pattern jumps out at us.  Is there a way we can find the <math>404^{th}</math> power of <math>\overline{13}</math> without taking this list all the way out to the <math>404^{th}</math> term -- or even without patiently waiting for the list to yield a pattern?
 +
 +
Suppose we condense the list we started above; and instead of writing down all powers of <math>\overline{13}</math>, we write only the powers <math>\overline{13}^k</math>, where <math>k</math> is a power of <math>2</math>.  We have
 +
 +
<math>\overline{13}^1 = \overline{13}</math>
 +
 +
<math>\overline{13}^2 = \overline{69}</math>
 +
 +
<math>\overline{13}^4 = \overline{69}^2 = \overline{61}</math>
 +
 +
<math>\overline{13}^8 = \overline{61}^2 = \overline{21}</math>
 +
 +
<math>\overline{13}^{16} = \overline{21}^2 = \overline{41}</math>
 +
 +
<math>\overline{13}^{32} = \overline{41}^2 = \overline{81}</math>
 +
 +
<math>\overline{13}^{64} = \overline{81}^2 = \overline{61}</math>
 +
 +
<math>\overline{13}^{128} = \overline{61}^2 = \overline{21}</math>
 +
 +
<math>\overline{13}^{256} = \overline{21}^2 = \overline{41}</math>
 +
 +
(Observe that this process yields a pattern of its own, if we carry it out far enough!)
 +
 +
Now, observe that, like any positive integer, <math>404</math> can be written as a sum of powers of two:
 +
 +
<math>404 = 256 + 128 + 16 + 4</math>
 +
 +
We can now use this powers-of-two expansion to compute <math>\overline{13}^{404}</math>:
 +
 +
<math>\overline{13}^{404} = \overline{13}^{256} \cdot \overline{13}^{128} \cdot \overline{13}^{16} \cdot \overline{13}^4 = \overline{41} \cdot \overline{21} \cdot \overline{41} \cdot \overline{61} = \overline{61}.</math>
 +
 +
So the tens and units digits of <math>13^{404}</math> are <math>6</math> and <math>1</math>, respectively.
 +
 +
We can use this method to compute <math>M^e</math> modulo <math>n</math>, for any integers <math>M</math> and <math>e</math>, with <math>e > 0</math>.  The beauty of this algorithm is that the process takes, at most, approximately <math>2 \log_2 e</math> steps -- at most <math>\log_2 e</math> steps to compute the values <math>\overline{M}^k</math> for <math>k</math> a power of two less than <math>e</math>, and at most <math>\log_2 e</math> steps to multiply the appropriate powers of <math>\overline{M}</math> according to the binary representation of <math>e</math>.
 +
 +
This method can be further refined using [[Euler's Totient Theorem]].
  
 
== Intermediate ==
 
== Intermediate ==

Revision as of 14:02, 27 June 2006

Modular arithmetic is a special type of arithmetic that involves only integers. Given integers $a$, $b$, and $n$, with $n > 0$, we say that $a$ is congruent to $b$ modulo $n$, or $a \equiv b$ (mod $n$), if the difference ${a - b}$ is divisible by $n$.

For a given positive integer $n$, the relation $a \equiv b$ (mod $n$) is an equivalence relation on the set of integers. This relation gives rise to an algebraic structure called the integers modulo $n$ (usually known as "the integers mod $n$," or $\mathbb{Z}_n$ for short). This structure gives us a useful tool for solving a wide range of number-theoretic problems, including finding solutions to Diophantine equations, testing whether certain large numbers are prime, and even some problems in cryptology.


Arithmetic Modulo n

Useful Facts

Consider four integers ${a},{b},{c},{d}$ and a positive integer ${m}$ such that $a\equiv b\pmod {m}$ and $c\equiv d\pmod {m}$. In modular arithmetic, the following identities hold:

  • Addition: $a+c\equiv b+d\pmod {m}$.
  • Subtraction: $a-c\equiv b-d\pmod {m}$.
  • Multiplication: $ac\equiv bd\pmod {m}$.
  • Division: $\frac{a}{e}\equiv \frac{b}{e}\pmod {\frac{m}{\gcd(m,e)}}$, where $e$ is a positive integer that divides ${a}$ and $b$.
  • Exponentiation: $a^e\equiv b^e\pmod {m}$ where $e$ is a positive integer.

Examples

  • ${7}\equiv {1} \pmod {2}$
  • $49^2\equiv 7^4\equiv (1)^4\equiv 1 \pmod {6}$
  • $7a\equiv 14\pmod {49}\implies a\equiv 2\pmod {7}$

The Integers Modulo n

The relation $a \equiv b$ (mod $n$) allows us to divide the set of integers into sets of equivalent elements. For example, if $n = 3$, then the integers are divided into the following sets:

$\{ \ldots, -6, -3, 0, 3, 6, \ldots \}$

$\{ \ldots, -5, -2, 1, 4, 7, \ldots \}$

$\{ \ldots, -4, -1, 2, 5, 8, \ldots \}$

Notice that if we pick two numbers $a$ and $b$ from the same set, then $a$ and $b$ differ by a multiple of $3$, and therefore $a \equiv b$ (mod $3$).

We sometimes refer to one of the sets above by choosing an element from the set, and putting a bar over it. For example, the symbol $\overline{0}$ refers to the set containing $0$; that is, the set of all integer multiples of $3$. The symbol $\overline{1}$ refers to the second set listed above, and $\overline{2}$ the third. The symbol $\overline{3}$ refers to the same set as $\overline{0}$, and so on.

Instead of thinking of the objects $\overline{0}$, $\overline{1}$, and $\overline{2}$ as sets, we can treat them as algebraic objects -- like numbers -- with their own operations of addition and multiplication. Together, these objects form the integers modulo $3$, or $\mathbb{Z}_3$. More generally, if $n$ is a positive integer, then we can define

$\mathbb{Z}_n = \{\overline{0}, \overline{1}, \overline{2}, \ldots, \overline{n-1} \}$,

where for each $k$, $\overline{k}$ is defined by

$\overline{k} = \{ m \in \mathbb{Z} \mbox{ such that } m \equiv k \pmod{n} \}.$

Addition, Subtraction, and Multiplication Mod n

We define addition, subtraction, and multiplication in $\mathbb{Z}_n$ according to the following rules:

$\overline{a} + \overline{b} = \overline{a+b}$ for all $a, b \in \mathbb{Z}$. (Addition)

$\overline{a} - \overline{b} = \overline{a-b}$ for all $a, b \in \mathbb{Z}$. (Subtraction)

$\overline{a} \cdot \overline{b} = \overline{ab}$ for all $a, b \in \mathbb{Z}$. (Multiplication)

So for example, if $n = 7$, then we have

$\overline{3} + \overline{2} = \overline{3+2} = \overline{5}$

$\overline{4} + \overline{4} = \overline{4+4} = \overline{8} = \overline{1}$

$\overline{4} \cdot \overline{3} = \overline{4 \cdot 3} = \overline{12} = \overline{5}$

$\overline{6} \cdot \overline{6} = \overline{6 \cdot 6} = \overline{36} = \overline{1}$

Notice that, in each case, we reduce to an answer of the form $\overline{k}$, where $0 \leq k < 7$. We do this for two reasons: to keep possible future calculations as manageable as possible, and to emphasize the point that each expression takes one of only seven (or in general, $n$) possible values. (Some people find it useful to reduce an answer such as $\overline{5}$ to $\overline{-2}$, which is negative but has a smaller absolute value.)

The Natural Appeal of Modular Arithmetic

Observe that we use modular arithmetic even when solving some of the most basic, everyday problems. For example:

Cody is cramming for an exam that will be held at 2 PM. It is the morning of the day of the exam, and Cody did not get any sleep during the night. He knows that it will take him exactly one hour to get to school from the time he wakes up, and he insists upon getting at least five hours of sleep. At what time in the morning should Cody stop studying and go to sleep?

We know that the hours of the day are numbered from $1$ to $12$, with hours having the same number if and only if they are a multiple of $12$ hours apart. So we can use subtraction mod $12$ to answer this question.

We know that since Cody needs five hours of sleep plus one hour to get to school, he must stop studying six hours before the exam. We can find out what time this is by performing the subtraction

$\overline{2} - \overline{6} = \overline{-4} = \overline{8}.$

So Cody must quit studying at 8 AM.

Of course, we are able to perform calculations like this routinely without a formal understanding of modular arithmetic. One reason for this is that the way we keep time gives us a natural model for addition and subtraction in $\mathbb{Z}_n$: a "number circle." Just as we model addition and subtraction by moving along a number line, we can model addition and subtraction mod $n$ by moving along the circumference of a circle. Even though most of us never learn about modular arithmetic in school, we master this computational model at a very early age.

A Word of Caution

Because of the way we define operations in $\mathbb{Z}_n$, it is important to check that these operations are well-defined. This is because each of the sets that make up $\mathbb{Z}_n$ contains many different numbers, and therefore has many different names. For example, observe that in $\mathbb{Z}_7$, we have $\overline{1} = \overline{8}$ and $\overline{2} = \overline{9}$. It is reasonable to expect that if we perform the addition $\overline{8} + \overline{9}$, we should get the same answer as if we compute $\overline{1} + \overline{2}$, since we are simply using different names for the same objects. Indeed, the first addition yields the sum $\overline{17} = \overline{3}$, which is the same as the result of the second addition.

The "Useful Facts" above are the key to understanding why our operations yield the same results even when we use different names for the same sets. The task of checking that an operation or function is well-defined, is one of the most important basic techniques in abstract algebra.

Computation of Powers Mod n

The "exponentiation" property given above allows us to perform rapid calculations modulo $n$. Consider, for example, the problem

What are the tens and units digits of $7^{1942}$?

We could (in theory) solve this problem by trying to compute $7^{1942}$, but this would be extremely time-consuming. Moreover, it would give us much more information than we need. Since we want only the tens and units digits of the number in question, it suffices to find the remainder when the number is divided by $100$. In other words, all of the information we need can be found using arithmetic mod $100$.

We begin by writing down the first few powers of $\overline{7}$:

$\overline{7}, \overline{49}, \overline{43}, \overline{1}, \overline{7}, \overline{49}, \overline{43}, \overline{1}, \ldots$

A pattern emerges! We see that $7^4 = 2401 \equiv 1$ (mod $100$). So for any positive integer $k$, we have $7^{4k} = (7^4)^k \equiv 1^k \equiv 1$ (mod $100$). In particular, we can write

$7^{1940} = 7^{4 \cdot 485} \equiv 1$ (mod $100$).

By the "multiplication" property above, then, it follows that

$7^{1942} = 7^{1940} \cdot 7^2 \equiv 1 \cdot 7^2 \equiv 49$ (mod $100$).

Therefore, by the definition of congruence, $7^{1942}$ differs from $49$ by a multiple of $100$. Since both integers are positive, this means that they share the same tens and units digits. Those digits are $4$ and $9$, respectively.

A General Algorithm

In the example above, we were fortunate to find a power of $7$ -- namely, $7^4$ -- that is congruent to $1$ mod $100$. What if we aren't this lucky? Suppose we want to solve the following problem:

What are the tens and units digits of $13^{404}$?

Again, we will solve this problem by computing $\overline{13}^{404}$ modulo $100$. The first few powers of $\overline{13}$ are

$\overline{13}, \overline{69}, \overline{97}, \overline{61}, \overline{93}, \ldots$

This time, no pattern jumps out at us. Is there a way we can find the $404^{th}$ power of $\overline{13}$ without taking this list all the way out to the $404^{th}$ term -- or even without patiently waiting for the list to yield a pattern?

Suppose we condense the list we started above; and instead of writing down all powers of $\overline{13}$, we write only the powers $\overline{13}^k$, where $k$ is a power of $2$. We have

$\overline{13}^1 = \overline{13}$

$\overline{13}^2 = \overline{69}$

$\overline{13}^4 = \overline{69}^2 = \overline{61}$

$\overline{13}^8 = \overline{61}^2 = \overline{21}$

$\overline{13}^{16} = \overline{21}^2 = \overline{41}$

$\overline{13}^{32} = \overline{41}^2 = \overline{81}$

$\overline{13}^{64} = \overline{81}^2 = \overline{61}$

$\overline{13}^{128} = \overline{61}^2 = \overline{21}$

$\overline{13}^{256} = \overline{21}^2 = \overline{41}$

(Observe that this process yields a pattern of its own, if we carry it out far enough!)

Now, observe that, like any positive integer, $404$ can be written as a sum of powers of two:

$404 = 256 + 128 + 16 + 4$

We can now use this powers-of-two expansion to compute $\overline{13}^{404}$:

$\overline{13}^{404} = \overline{13}^{256} \cdot \overline{13}^{128} \cdot \overline{13}^{16} \cdot \overline{13}^4 = \overline{41} \cdot \overline{21} \cdot \overline{41} \cdot \overline{61} = \overline{61}.$

So the tens and units digits of $13^{404}$ are $6$ and $1$, respectively.

We can use this method to compute $M^e$ modulo $n$, for any integers $M$ and $e$, with $e > 0$. The beauty of this algorithm is that the process takes, at most, approximately $2 \log_2 e$ steps -- at most $\log_2 e$ steps to compute the values $\overline{M}^k$ for $k$ a power of two less than $e$, and at most $\log_2 e$ steps to multiply the appropriate powers of $\overline{M}$ according to the binary representation of $e$.

This method can be further refined using Euler's Totient Theorem.

Intermediate

Divisibility Tests

Modular arithmetic is the basis for several well-known divisibility tests. Consider, for example, the test for divisibility by $9$:

Let $N$ be a positive integer. Then $N$ is divisible by $9$ if and only if the sum of the base-ten digits of $N$ is divisible by $9$.

Arithmetic mod $9$ can be used to give an easy proof of this criterion:

Suppose that the base-ten representation of $N$ is

$N = a_k a_{k-1} \cdots a_2 a_1 a_0$,

where $a_i$ is a digit for each $i$. Then the numerical value of $N$ is given by

$N = a_k \cdot 10^k + a_{k-1} \cdot 10^{k-1} + \cdots + a_1 \cdot 10^1 + a_0 \cdot 10^0$.

Now we know that, since $10 - 1 = 9$, we have $10 \equiv 1$ (mod $9$). So by the "exponentiation" property above, we have $10^j \equiv 1^j \equiv 1$ (mod $9$) for every $j$.

Therefore, by repeated uses of the "addition" and "multiplication" properties, we can write

$a_k \cdot 10^k + a_{k-1} \cdot 10^{k-1} + \cdots + a_1 \cdot 10^1 + a_0 \cdot 10^0 \equiv a_k \cdot 1 + a_{k-1} \cdot 1 + \cdots + a_1 \cdot 1 + a_0 \cdot 1$ (mod $9$).

Therefore, we have

$N \equiv a_k + a_{k-1} + \cdots + a_1 + a_0$ (mod $9$).

That is, $N$ differs from the sum of its digits by a multiple of $9$. It follows, then, that $N$ is a multiple of $9$ if and only if the sum of its digits is a multiple of $9$.

A virtually identical argument shows that a positive integer is divisible by $3$ if and only if the sum of its base-ten digits is divisible by $3$. We can also use the technique shown above to devise a test for divisibility by $11$.

Topics

See also

Miscellany

The binary operation "mod"

Related to the concept of congruence, mod $n$ is the binary operation $a$ mod $n$, which is used often in computer programming.

Recall that, by the Division Algorithm, given any two integers $a$ and $n$, with $n > 0$, we can find integers $q$ and $r$, with $0 \leq r < n$, such that $a = nq + r$. The number $q$ is called the quotient, and the number $r$ is called the remainder. The operation $a$ mod $n$ returns the value of the remainder $r$. For example:

$15$ mod $6 = 3$, since $15 = 6 \cdot 2 + 3$.

$35$ mod $7 = 0$, since $35 = 7 \cdot 5 + 0$.

$-10$ mod $8 = 6$, since $-10 = 8 \cdot -2 + 6$.

Observe that if $a$ mod $n = r$, then we also have $a \equiv r$ (mod $n$).


Resources