55, it can be determined whether an image captured by the imaging unit 22 is one captured with the digital camera 100 held landscape or one captured with the digital camera 100 held portrait. The system control unit 50 can attach orientation information based on the orientation detected by the orientation detection unit 55 to the image file of the image captured by the imaging unit 22, or rotate the image and record the rotated image. An acceleration sensor or a gyro sensor can be used as the orientation detection unit 55. The movement (e.g., pan, tilt, lift, and whether at rest or not) of the digital camera 100 can also be detected using the acceleration sensor or gyro sensor serving as the orientation detection unit 55.

The eye access detection unit 57 is an eye access detection sensor for detecting approach (eye access) and separation (eye separation) of the eye (object) 161 to/from the eyepiece unit 16 of the viewfinder (approach detection). The system control unit 50 switches display (display state) and non-display (non-display state) of the display unit 28 and the EVF 29 depending on the state detected by the eye access detection unit 57. More specifically, suppose that the digital camera 100 is at least in the imaging standby state and a display destination switch setting of the LV image captured by the imaging unit 22 is an automatic switch setting. In such a case, the system control unit 50 turns display on with the display unit 28 as the display destination and hides the EVF 29 during non-eye access. The system control unit 50 turns display on with the EVF 29 as the display destination and hides the display unit 28 during eye access. An infrared proximity sensor can be used as the eye access detection unit 57, for example. The eye access detection unit 57 can detect approach of an object to the eyepiece unit 16 of the viewfinder having the built-in EVF 29. If an object approaches, infrared rays projected from a light projection part (not illustrated) of the eye access detection unit 57 are reflected from the object and received by a light reception part (not illustrated) of the infrared proximity sensor. The distance of the approaching object to the eyepiece unit 16 (eye access distance) can also be determined based on the amount of infrared rays received. The eye access detection unit 57 thus performs eye access detection to detect the proximity distance of the object to the eyepiece unit 16. In the present exemplary embodiment, suppose that the light projection part and the light reception part of the eye access detection unit 57 are devices separate from the infrared light-emitting diode 166 and the line of sight detection sensor 164 described above. However, the infrared light-emitting diode 166 can serve as the light projection part of the eye access detection unit 57. The line of sight detection sensor 164 can also serve as the light reception part.

When an object approaching from a non-eye access state (non-approaching state) to within a predetermined distance from the eyepiece unit 16 is detected, eye access is detected. When the object of which the approach is detected in an eye access state (approaching state) gets separated a predetermined distance or more, eye separation is detected. The threshold for detecting eye access and the threshold for detecting eye separation may be different from each other. For example, the thresholds can have a hysteresis. After the detection of eye access, the eye access state lasts until eye separation is detected.

After the detection of eye separation, the non-eye access state lasts until eye access is detected. Note that the infrared proximity sensor is just an example, and any other sensor capable of detecting the approach of an eye or object that can be considered to be eye access can be used as the eye access detection unit 57.

Based on the output from the line of sight detection block 160, the system control unit 50 can detect the following operations or states:

- That the line of sight of the user making eye access to the eyepiece unit 16 is newly input (detected). That is, a start of a line of sight input.
- A state where there is a line of sight input of the user making eye access to the eyepiece unit 16.
- A state where the user making eye access to the eyepiece unit 16 is gazing.
- That the user making eye access to the eyepiece unit 16 looks away. That is, an end of the light of sight input.
- A state where the user making eye access to the eyepiece unit 16 is not making any line of sight input.

As employed herein, gazing refers to a case where the amount of movement of the user's line of sight position does not exceed a predetermined amount of movement within a predetermined time.

The touchscreen 70a and the display unit 28 can be integrally configured. For example, the touchscreen 70a is configured such that the light transmittance thereof does not interfere with the display of the display unit 28, and attached onto the display screen of the display unit 28. The input coordinates of the touchscreen 70a and the display coordinates on the display surface of the display unit 28 are then associated with each other. This can provide a graphical user interface (GUI) as if the user can directly operate the screen displayed on the display unit 28. The system control unit 50 can detect the following operations or states of the touchscreen 70a:

- That a finger or pen that has not being touching the touchscreen 70a makes a new touch on the touchscreen 70a. That is, a start of a touch (hereinafter, referred to as a touch-down).
- A state where a finger or pen is touching the touchscreen 70a (hereinafter, referred to as a touch-on).
- That a finger or pen touching the touchscreen 70a is moving (hereinafter, referred to as a touch-move).
- That a finger or pen that has being touching the touchscreen 70a is released. That is, an end of a touch (hereinafter, referred to as a touch-up).
- A state where nothing is touching the touchscreen 70a (hereinafter, referred to as a touch-off).

If a touch-down is detected, a touch-on is detected at the same time. After a touch-down, a touch-on usually continues to be detected unless a touch-up is detected. A touch-move is detected in a state where a touch-on is detected. If a touch-on is detected and the touch position does not move, a touch-move is not detected. After a touch-up of all fingers and pens touching is detected, a touch-off is detected.

The system control unit 50 is notified of such operations and states and the position coordinates of the touching fingers and pens on the touch screen 70a, via an internal bus. The system control unit 50 determines what operation (touch operation) is performed on the touchscreen 70a based on the notified information. In the case of a touch-move, the vertical and horizontal components of the moving direction of a finger or pen moving on the touchscreen 70a can be separately determined based on a change in the position coordinates. If a touch move is detected for a predetermined distance or more, a slide operation is determined to be performed. An operation of quickly moving a finger touching the touchscreen 70a for some distance and immediately releasing the finger is called flick. In other words, a flick is an operation of quickly moving the finger along the touchscreen 70a as if flicking. A flick can be determined to be performed (a flick can be determined to be performed after a slide operation) if a touch-move for a predetermined distance or more at a predetermined speed or more is detected and a touch-up is immediately detected. A touch operation of simultaneously touching a plurality of points (for example, two points) and bringing the touch positions close to each other will be referred to as a pinch-in, and a touch operation of moving the touch positions away from each other as a pinch-out. A pinch-out and a pinch-in are collectively referred to as a pinch operation (or simply a pinch). Any one of touchscreens of various methods including resistive, capacitive, surface acoustic wave, infrared, electromagnetic induction, image recognition, and optical sensor methods can be used as the touchscreen 70a. In some methods, the presence of a touch is detected based on contact with the touchscreen. In some methods, the presence of a touch is detected based on approach of a finger or pen to the touchscreen. Either type of method can be used.

The user can set a method for designating the position of a position index based on a touch-move operation performed in an eye access state, to either absolute positioning or relative positioning. For example, suppose that the position index is an AF frame. In the case of absolute positioning, if the touchscreen 70a is touched, an AF position associated with the touched position (position of which the coordinates are input) is set. In other words, the position coordinates where the touch operation has been performed and the position coordinates on the display unit 28 are associated with each other. By contrast, in the case of relative positioning, the position coordinates where the touch operation has been performed and the position coordinates on the display unit 28 are not associated with each other. In relative positioning, the touch position is moved from the currently set AF position in the direction of movement of the touch-move as much as the distance corresponding to the amount of movement of the touch-move regardless of the touch-down position on the touchscreen 70a.

Setting Screen

FIGS. 3A to 3E are diagrams related to a menu for changing setting values displayed on the display unit 28 or the EVF 29.

FIG. 3A illustrates a menu setting screen with setting items 301 to 305 and respective setting values.

The setting item 301 is used for AF operation, and it can be set to “one-shot AF” to lock focus after an AF activation (after the imaging preparation instruction) or “servo AF” to perform focus tracking.

The setting item 302 is an AF area setting item, where the size of the area to perform AF can be set.

If the setting values are large in number, the setting is made using a dedicated sublevel screen (FIG. 3B). As illustrated in FIG. 3B, the user selects a setting value 306 from a list of setting values.

The setting item 303 is a tracking setting item, where whether to perform tracking after the AF is activated (after the imaging preparation instruction) can be set. An object to be tracked is determined from an AF area before the AF activation (before the imaging preparation instruction), and the size of the AF area is increased to the entire area to track the object over the entire screen after the AF activation (after the imaging preparation instruction). If this setting is on and there is a main object detected, a detection frame is displayed around the main object for user notification. The main object is determined based on the setting of the setting item 304, i.e., the type of object to be detected.

The setting item 304 is a setting item for an object to be detected, where the type of object to give priority to in determining the main object is selected. In the present exemplary embodiment, as illustrated in FIG. 3D, the type can be selected from “human figure” 310, “animal priority”, “vehicle priority”, and “off”. Some setting values can be set in more detail, like a setting item 311. Here, the image processing unit 24 can detect a specific object using captured image data. In the present exemplary embodiment, human figures, animals such as dogs and birds, vehicles, and main areas of such objects are detected (spot-detected) as specific objects. For example, the body, head, pupils, and face can be spot-detected from a human figure. For example, the pupils, face, and body can be spot-detected from an animal. Spot detection can also be set when vehicle priority is selected. For example, the driver of a car, the first car of a train, or the cockpit of an airplane is detected by priority. Machine learning-based training techniques and image processing-based recognition processing are used for such detection methods.

Examples of types of machine learning include the following:

- (1) support vector machines,
- (2) convolutional neural networks, and
- (3) recurrent neural networks.

An example of the recognition processing in the case of detecting a face is a method for extracting a skin-color area based on pixel tones expressed by image data and detecting a face based on the degrees of matching with face contour templates prepared in advance. Another example is a method for performing face detection by extracting facial feature points, such as the eyes, nose, and mouth, using conventional pattern recognition techniques. The main area detection techniques applicable to the present exemplary embodiment are not limited thereto, and other techniques can be used.

FIG. 3C illustrates a menu screen where an AF area setting 309 and a tracking setting 308 can be simultaneously set. Here, the LV image is displayed on the background, and the user can change the settings while viewing an AF area 307. FIG. 3E illustrates a menu screen for setting whether to hold the frame position when tracking is stopped. A setting item 1201 can set whether to hold the frame position when tracking is stopped. If the setting item 1201 is set to on, the frame position is held when tracking is stopped. If the setting item 1201 is set to off, the frame position is not held when tracking is stopped. The provision of such a user setting enables detailed tracking settings. This menu screen can be hidden on the assumption that the setting item 1201 is fixed to on.

Customized Button Functions

FIGS. 4A to 4F are diagrams illustrating a menu for setting customized button functions for activating tracking and calling functions to be displayed on the display unit 28 or the EVF 29.

Button customization for activating tracking will be described. For example, as illustrated in FIG. 4A, the user points a cursor (marker) indicating the position of the current processing target to an operation member (for example, button) to be assigned 401 onscreen. In FIG. 4B, functions to be assigned 402 are thereby displayed in a selectable manner. In FIG. 4B, the set button is assigned “start/stop tracking”. The function “start/stop tracking” is to start tracking based on the position of the AF area and stop the started tracking regardless of the tracking setting. This function can be activated even during imaging standby (SW0), while AF is on (the first shutter switch 62 is being held, i.e., the first shutter switch signal SW1 is on), or during servo AF (the second shutter switch signal SW2 is on). As illustrated in FIG. 4F, the set button can be assigned a function 409 of temporarily starting or stopping tracking as with “start/stop tracking” only while the assigned custom key (SET button) is pressed by the user.

For example, if the user points the cursor to a button to be assigned 403 onscreen as illustrated in FIG. 4C, functions to be assigned 404 are displayed in a selectable manner as illustrated in FIG. 4D. In this diagram, the AE lock (AEL) button 77 is assigned “call registered function”.

The function “call registered function” is to call a function registered in advance by the user. If a setting item 405 in FIG. 4D is pressed by the user, a detailed setting screen illustrated in FIG. 4E appears. In FIG. 4E, the user can register a function to be called by selecting a setting item 407 of the function to be called, setting a setting value 408, and checking a checkbox 406. In FIG. 4E, an AF operation “one-shot” and a call position “home position (HP)” are registered. In setting an item, other items can be grayed out to indicate that such items are unable to be registered. For example, in FIG. 4E, the AF area setting item is grayed out to indicate that the AF area is unable to be registered. Setting items not checked by the user, like the tracking setting item and the spot detection setting item in FIG. 4E, will not be changed from the current setting values.

Imaging Information Display and Icons Indicating Setting Values

FIGS. 5A and 5B are diagrams for describing imaging information display and icons indicating setting values displayed on the display unit 28 or the EVF 29.

FIG. 5A illustrates an example of a display screen on the display unit 28. An icon 501 indicates an AF area and tracking setting, an icon 502 an AF operation setting, an icon 503 an object to be detected setting, and an icon 504 a pupil detection setting. An icon 505 indicates the state of activation of tracking. The user can find out the current settings and states by observing the icons 501 to 505.

FIG. 5B illustrates examples of lists of icon displays. An icon expressed by a combination of an AF area and a tracking setting, such as an icon 506, is displayed as the icon 501. Icons prepared for respective setting values, such as icons 507, 508, and 509, are displayed as the icons 502, 503, and 504. An icon indicating the state of activation of tracking, such as an icon 510, is displayed as the icon 505.

Frames Displayed Before and After AF Activation

FIG. 6 is a diagram illustrating frames displayed on the display unit 28 or the EVF 29 before and after the AF activation.

In FIG. 6, different frames are displayed between before and after the activation of the AF. However, the same frames can be displayed. A distinction can be made using different colors, like a frame for one-shot AF operation is displayed in green and a frame for servo AF in blue.

An AF area frame 601 indicates a narrow area, such as a spot, single-point, and point expansion areas. The AF area frame 601 before the AF activation is a rectangle, and an AF area frame 602 after the AF activation is a thick rectangle.

An AF area frame 603 indicates a wide area, such as a zone and an entire area. Before the AF activation, the AF area frame 603 indicates the area with brackets [ ]. After the AF activation, small rectangular frames 604 are displayed only at in-focus points within the AF area frame 603. A plurality of rectangular frames 604 can be displayed in the area. If the AF area frame 603 indicates the entire screen area, the brackets [ ] may be hidden before the AF activation.

A detection frame 605 is displayed around an object automatically detected based on the object to be detected setting. In the diagram, the object to be detected is set to “human figure”, and the detection frame 605 is displayed around a human face. Depending on the pupil detection setting, detection frames 605 can be displayed around pupil areas. If the object to be detected is set to “animal” or “vehicle”, the detection frame 605 is displayed around the entire body or face of an animal or a vehicle. After the AF activation, a rectangular detection frame 606 is displayed according to the detection frame 605. In the present exemplary embodiment, the detection frame 606 is expressed by a dotted line for the sake of distinction from the AF area frame 602. The detection frame can be updated frame by frame to track the object. If the one-shot AF is activated, the frame position is fixed afterward at the in-focus position.

If the user selects the detection frame 605 or a tracking object by a user operation, a tracking frame 607 is displayed. Examples of the user's selection operation include selection with reference to an operation position on the touchscreen 70a, selection through a tracking start operation, and selection from a plurality of detection frames using the directional keypad 74. After the AF activation, the tracking frame is expressed by a dotted double-lined rectangle 608. Similarly to the detection frame, the tracking frame can be updated frame by frame to track the object. If the one-shot AF is activated, the tracking frame is fixed afterward at the in-focus position.

Frame Expressions Depending on Combinations of AF Area and Tracking Setting

FIG. 7 is a diagram illustrating frame expressions depending on the combinations of the AF area and the tracking setting.

States 7-A to 7-I correspond to the combinations of tracking “off” and the AF areas. States 7-J to 7-R correspond to the combinations of tracking “on” and the AF areas. Each state illustrates a case where the “AF area frame”, the “detection frame”, or the “tracking frame” is active.

States 7-A to 7-I where the tracking is “off” will initially be described.

If the AF area frame is active, AF area frames corresponding to the respective settings, such as a single-point AF area frame 701 and a zone AF area frame 702, are displayed (states 7-A, 7-B, and 7-C).

If the tracking is “off”, the object detection processing is not performed and thus the detection frame does not become active. No frame is thus displayed in state 7-D, 7-E, or 7-F. For the convenience of description, FIG. 7 illustrates the screens in states 7-D, 7-E, and 7-F in gray, whereas an LV display is provided.

If an object is selected by the user, a tracking frame 703 is displayed (states 7-G, 7-H, and 7-I). Examples of the tracking frame here include the tracking frame when tracking is started based on an operation position on the touchscreen 70a and the tracking frame when tracking is started with reference to the position of a tracking start operation.

Next, states 7-J to 7-R where the tracking is “on” will be described.

In states 7-J to 7-O, if a main object is detected, both the AF area frame and the detection frame are displayed, and the frame to be actually used for focusing upon AF activation becomes active. If a main object is not detected, only the AF area is displayed as is the case where the tracking is “off”.

With the main object detected, the frame to be actually used for focusing upon the AF activation is selected in the following manner.

Initially, if the detection frame does not overlap the AF area frame, the AF area frame becomes active (states 7-J and 7-K). If the AF area is the entire area of the screen and no object is detected within the AF area, the entire AF area becomes active (state 7-L) since the detection frame does not overlap the AF area frame. In such a case, however, the AF area frame is hidden since the AF area is the entire area of the screen. For the convenience of description, the screen is illustrated in gray, whereas an LV display is provided. If the AF area frame is active, an AF area frame 704 or 706 is displayed in solid lines, and a detection frame 705 is expressed by translucent lines. When the AF is activated, the focus is adjusted using the AF area frame.

If the detection frame overlaps the AF area frame, the detection frame becomes active (states 7-M, 7-N, and 7-O). In the cases of pupil detection and spot detection, the detection frame can be active without the pupils or the spot overlapping the AF area frame if the face or the object's entire body overlaps the AF area frame. If the detection frame is active, a detection frame 707 is expressed by solid lines and an AF area frame 708 is expressed by translucent lines.

If an object is selected by the user and a main object is detected, the tracking frame 709 is active and displayed alone during tracking (states 7-P, 7-Q, and 7-R).

State Transitions in Case of Servo AF

FIGS. 8A and 8B are diagrams illustrating state transitions in the case of servo AF.

FIG. 8A illustrates the transitions of states 8-A to 8-R with the tracking setting “on”. FIG. 8B illustrates the transitions of states 8-a to 8-r with the tracking setting “off”.

State 8-A illustrated in FIG. 8A represents an imaging standby state (SW0). Icons 801 to 805 indicate setting values and state values. The icon 801 indicates single-point AF with the tracking setting “on”. The icon 802 indicates that the AF operation is servo AF. The icon 803 indicates that the object to be detected is a human figure. The icon 804 indicates that the pupil detection is off. The icon 805 indicates that the tracking state is turned off. Since a detection frame 807 overlaps an AF area frame 806, the detection frame 807 becomes active and the AF area frame 806 inactive. If a “start tracking” operation is performed in such a state, the state proceeds to state 8-B. If an AF operation (imaging preparation operation [SW1]) is performed, the state proceeds to state 8-G.

In state 8-B, the system control unit 50 updates a tracking frame 808 to follow the movement of the object. The icon 805 is switched to on. If a “stop tracking” operation is performed in such a state, the state returns to state 8-A. If an AF operation (imaging preparation operation [SW1]) is performed, the state proceeds to state 8-G.

In state 8-C, the system control unit 50 updates a tracking frame 809 to follow the movement of the object. If a “stop tracking” operation is performed here, the state proceeds to state 8-D. If an AF operation (imaging preparation operation [SW1]) is performed, the state proceeds to state 8-H.

In state 8-D, the system control unit 50 displays an AF area frame 810 and a detection frame 811. Here, the AF area frame 810 is active. If a frame moving operation is performed in such a state, the state proceeds to state 8-E.

In state 8-E, the system control unit 50 displays an AF area frame 812 and a detection frame 813. Here, the AF area frame 812 is active. If a “start tracking” operation is performed in such a state, the state proceeds to state 8-F. If an AF operation is performed, the state proceeds to state 8-K.

In state 8-F, the system control unit 50 updates a tracking frame 814 to follow the movement of the object. The icon 805 is switched to on. If a “stop tracking” operation is performed in such a state, the state returns to state 8-E. If an AF operation (imaging preparation operation [SW1]) is performed, the state proceeds to state 8-K.

In state 8-G, the system control unit 50 updates a tracking frame 815 to follow the movement of the object while continuing to focus on the object (continuous AF). The icon 805 is switched to on. If the object to be tracked moves in such a state, the state proceeds to state 8-H. If a “stop tracking” operation is performed, the state proceeds to state 8-Q. If the AF is cancelled (imaging preparation operation [SW1] is cancelled), the state returns to state 8-A. If an imaging operation (SW2) is performed, the state proceeds to state 8-L.

In state 8-Q, the system control unit 50 continues to focus on the object in an AF area 826. The tracking state is turned off. If an imaging operation is performed in such a state, the state proceeds to state 8-R.

In state 8-H, the system control unit 50 updates a tracking frame 816 to follow the movement of the object while continuing to focus on the object.

If a “stop tracking” operation is performed in such a state, the state proceeds to state 8-I. If an imaging operation (SW2) is performed, the state proceeds to state 8-M. If the AF is cancelled (imaging preparation operation [SW1] is cancelled), the state returns to state 8-D.

In state 8-I, the system control unit 50 continues to focus on the object in an AF area 817. The tracking state is turned off. If an imaging operation (SW2) is performed in such a state, the state proceeds to state 8-N. If the AF is cancelled (imaging preparation operation [SW1] is cancelled), the state returns to state 8-D.

In state 8-J, the system control unit 50 moves an AF area 818 according to the user's operation. When moving the AF area 818, the system control unit 50 continues to focus on the object in the AF area 818. If an imaging operation (SW2) is performed in such a state, the state proceeds to state 8-O. If the AF is cancelled (imaging preparation operation [SW1] is cancelled), the state returns to state 8-E. If a “start tracking” operation is performed, the state proceeds to state 8-K.

In state 8-K, the system control unit 50 updates a tracking frame 819 to follow the movement of the object while continuing to focus on the object.

If a “stop tracking” operation is performed in such a state, the state returns to state 8-J. If an imaging operation (SW2) is performed, the state proceeds to state 8-P. If the AF is cancelled (imaging preparation operation [SW1] is cancelled), the state returns to state 8-E or 8-F.

In state 8-L, the system control unit 50 updates a tracking frame 821 to follow the movement of the object while continuing to focus on the object, and captures an image. That imaging is in progress can be determined from display 820. If the drive mode is set to continuous shooting, the system control unit 50 tracks the focus position and continues to capture images. If the object to be tracked moves in such a state, the state proceeds to state 8-M. If the imaging operation (SW2) is cancelled, the state returns to state 8-G. If a “stop tracking” operation is performed, the state returns to state 8-R.

In state 8-R, the system control unit 50 continues to focus on the object in an AF area 827, and captures an image. The tracking state is turned off. If a “start tracking” operation is performed in such a state, the state proceeds to state 8-L. If the imaging operation (SW2) is cancelled, the state returns to state 8-Q.

In state 8-M, the system control unit 50 updates a tracking frame 822 to follow the movement of the object while continuing to focus on the object, and captures an image. If the imaging operation (SW2) is cancelled in such a state, the state returns to state 8-H. If a “stop tracking” operation is performed, the state proceeds to state 8-N.

In state 8-N, the system control unit 50 continues to focus on the object in an AF area 823, and captures an image. The tracking state is turned off. If a frame moving operation is performed in such a state, the state proceeds to state 8-O. If the imaging operation (SW2) is cancelled, the state returns to state 8-I.

In state 8-O, the system control unit 50 continues to focus on the object in an AF area 824, and captures an image. If the imaging operation (SW2) is cancelled in such a state, the state returns to state 8-J. If a “start tracking” operation is performed in such a state, the state proceeds to state 8-P.

In state 8-P, the system control unit 50 updates a tracking frame 825 to follow the movement of the object while continuing to focus on the object, and captures an image. If the imaging operation (SW2) is cancelled in such a state, the state returns to state 8-K. If a “stop tracking” operation is performed, the state returns to state 8-O.

State 8-a illustrated in FIG. 8B represents the imaging standby state. Icons 801a to 805a indicate setting values and state values. The icon 801a indicates single-point AF with the tracking setting “off”. The icon 802a indicates that the AF operation is servo AF. The icon 803a indicates that the object to be detected is a human figure. The icon 804a indicates that the pupil detection is off. The icon 805a indicates that the tracking state is turned off. The system control unit 50 displays an AF area frame 806a. If a “start tracking” operation is performed in such a state, the state proceeds to state 8-b. If an AF operation (imaging preparation operation [SW1]) is performed, the state proceeds to state 8-q.

In state 8-b, the system control unit 50 updates a tracking frame 808a to follow the movement of the object. The icon 805a is switched to on. If a “stop tracking” operation is performed in such a state, the state returns to state 8-a. If an AF operation (imaging preparation operation [SW1]) is performed, the state proceeds to state 8-g.

In state 8-c, the system control unit 50 updates a tracking frame 809a to follow the movement of the object. If a “stop tracking” operation is performed here, the state proceeds to state 8-d. If an AF operation (imaging preparation operation [SW1]) is performed, the state proceeds to state 8-h.

In state 8-d, the system control unit 50 displays an AF area frame 810a. If a frame moving operation is performed in such a state, the state proceeds to state 8-e.

In state 8-e, the system control unit 50 displays an AF area frame 812a. If a “start tracking” operation is performed in such a state, the state proceeds to state 8-f. If an AF operation is performed, the state proceeds to state 8-j.

In state 8-f, the system control unit 50 updates a tracking frame 814a to follow the movement of the object. The icon 805a is switched to on. If a “stop tracking” operation is performed in such a state, the state returns to state 8-e. If an AF operation (imaging preparation operation [SW1]) is performed, the state proceeds to state 8-k.

In state 8-g, the system control unit 50 updates a tracking frame 815a to follow the movement of the object while continuing to focus on the object. The icon 805a is switched to on. If the object to be tracked moves in such a state, the state proceeds to state 8-h. If a “stop tracking” operation is performed, the state proceeds to state 8-q. If the AF is cancelled, the state returns to state 8-b. If an imaging operation (SW2) is performed, the state proceeds to state 8-l.

In state 8-q, the system control unit 50 continues to focus on the object in an AF are 826a. The tracking state is turned off. If an imaging operation (SW2) is performed in such a state, the state proceeds to state 8-r.

In state 8-h, the system control unit 50 updates a tracking frame 816a to follow the movement of the object while continuing to focus on the object. If a “stop tracking” operation is performed in such a state, the state proceeds to state 8-i. If an imaging operation (SW2) is performed, the state proceeds to state 8-m. If the AF is cancelled (imaging preparation operation [SW1] is cancelled), the state returns to state 8-d.

In state 8-i, the system control unit 50 continues to focus on the object in an AF area 817a. The tracking state is turned off. If an imaging operation (SW2) is performed in such a state, the state proceeds to state 8-n. If the AF is cancelled (imaging preparation operation [SW1] is cancelled), the state returns to state 8-d.

In state 8-j, the system control unit 50 moves an AF area 818a based on the user's operation. When moving the AF area 818a, the system control unit 50 continues to focus on the object in the AF area 818a. If an imaging operation (SW2) is performed in such a state, the state proceeds to state 8-o. If the AF is cancelled (imaging preparation operation [SW1] is cancelled), the state returns to state 8-e. If a “start tracking” operation is performed, the state proceeds to state 8-k.

In state 8-k, the system control unit 50 updates a tracking frame 819a to follow the movement of the object while continuing to focus on the object. If a “stop tracking” operation is performed in such a state, the state returns to state 8-j. If an imaging operation (SW2) is performed, the state proceeds to state 8-p. If the AF is cancelled (imaging preparation operation [SW1] is cancelled), the state returns to state 8-e or 8-f.

In state 8-l, the system control unit 50 updates a tracking frame 821a to follow the movement of the object while continuing to focus on the object, and captures an image. That imaging is in progress can be determined from display 820a. If the drive mode is set to continuous shooting, the system control unit 50 tracks the focus position and continues to capture images. If the object to be tracked moves in such a state, the state proceeds to state 8-m. If the imaging operation (SW2) is cancelled, the state returns to state 8-g. If a “stop tracking” operation is performed, the state returns to state 8-r.

In state 8-r, the system control unit 50 continues to focus on the object in an AF area 827a, and captures an image. The tracking state is turned off. If a “start tracking” operation is performed in such a state, the state proceeds to state 8-l. If the imaging operation (SW2) is cancelled, the state returns to state 8-q.

In state 8-m, the system control unit 50 updates a tracking frame 822a to follow the movement of the object while continuing to focus on the object, and captures an image. If the imaging operation (SW2) is cancelled in such a state, the state returns to state 8-h. If a “stop tracking” operation is performed, the state returns to state 8-n.

In state 8-n, the system control unit 50 continues to focus on the object in an AF area 823a, and captures an image. The tracking state is turned off. If a frame moving operation is performed in such a state, the state proceeds to state 8-o. If the imaging operation (SW2) is cancelled, the state returns to state 8-i.

In state 8-o, the system control unit 50 continues to focus on the object in an AF area 824a, and captures an image. If the imaging operation (SW2) is cancelled in such a state, the state returns to state 8-j. If a “start tracking” operation is performed, the state proceeds to state 8-p.

In state 8-p, the system control unit 50 updates a tracking frame 825a to follow the movement of the object while continuing to focus on the object, and captures an image. If the imaging operation (SW2) is cancelled in such a state, the state returns to state 8-k. If a “stop tracking” operation is performed, the state returns to state 8-o.

State Transitions in Case of One-Shot AF

FIGS. 9A and 9B are diagrams illustrating state transitions in the case of one-shot AF.

FIG. 9A illustrates the transitions of states 9-A to 9-O with the tracking setting “on”. FIG. 9B illustrates the transitions of states 9-a to 9-o with the tracking setting “off”.

In state 9-A illustrated in FIG. 9A, the system control unit 50 displays icons 901 to 905 indicating setting values and state values. The icon 901 indicates single-point AF with the tracking setting “on”. The icon 902 indicates that the AF operation is one-shot AF. The icon 903 indicates that the object to be detected is a human figure. The icon 904 indicates that the pupil detection is off. The icon 905 indicates that the tracking setting is off. Since a detection frame 907 overlaps an AF area frame 906, the detection frame 907 becomes active and the AF area frame 906 inactive. If a “start tracking” operation is performed in such a state, the state proceeds to state 9-B. If an AF operation (imaging preparation operation [SW1]) is performed, the state proceeds to state 9-F.

In state 9-B, the system control unit 50 tracks the object using a tracking frame 908. The icon 905 is switched to on. If a “stop tracking” operation is performed in such a state, the state returns to state 9-A. If an AF operation (imaging preparation operation [SW1]) is performed, the state proceeds to state 9-G. If the object moves in XY directions of the screen, the state proceeds to state 9-C.

In state 9-C, the system control unit 50 updates a tracking frame 909 to follow the movement of the object. If a “stop tracking” operation is performed in such a state, the state proceeds to state 9-D. If an AF operation (imaging preparation operation [SW1]) is performed, the state proceeds to state 9-H.

In state 9-D, a detection frame 911 falls outside an AF area frame 910, and thus the AF area frame 910 becomes active and the detection frame 911 inactive. If a “start tracking” operation is performed in such a state, the state proceeds to state 9-E. If an AF operation (imaging preparation operation [SW1]) is performed, the state proceeds to state 9-I.

In state 9-E, the system control unit 50 updates a tracking frame 912 to follow the movement of the object to be tracked. The icon 905 is switched to on. If a “stop tracking” operation is performed in such a state, the state returns to state 9-D. If an AF operation (imaging preparation operation [SW1]) is performed, the state proceeds to state 9-J.

In state 9-F, the system control unit 50 performs one-shot AF using a detection frame 913, and locks the focus position. If an imaging operation (SW2) is performed in such a state, the state proceeds to state 9-K. If a “start tracking” operation is performed, the state proceeds to state 9-G. If the AF operation (imaging preparation operation [SW1]) is cancelled, the state returns to state 9-A.

In state 9-G, the system control unit 50 performs one-shot AF using a tracking frame 914, and locks the focus position. If a “stop tracking” operation is performed in such a state, the state returns to state 9-F. If an imaging operation (SW2) is performed, the state proceeds to state 9-L. If the AF operation (imaging preparation operation [SW1]) is cancelled, the state returns to state 9-B.

In state 9-H, the system control unit 50 performs one-shot AF using a tracking frame 915, and locks the focus position. If a “stop tracking” operation is performed in such a state, the state proceeds to state 9-I. If an imaging operation (SW2) is performed, the state proceeds to state 9-M. If the AF operation (imaging preparation operation [SW1]) is cancelled, the state returns to state 9-C.

In state 9-I, the system control unit 50 performs one-shot AF using an AF area frame 916, and locks the focus position.

If a “start tracking” operation is performed in such a state, the state proceeds to state 9-J. If an imaging operation (SW2) is performed, the state proceeds to state 9-N. If the AF operation (imaging preparation operation [SW1]) is cancelled, the state returns to state 9-D.

In state 9-J, the system control unit 50 performs one-shot AF using a tracking frame 917, and locks the focus position. The icon 905 is switched to on. If a “stop tracking” operation is performed in such a state, the state returns to state 9-I. If an imaging operation (SW2) is performed, the state proceeds to state 9-O. If the AF operation (imaging preparation operation [SW1]) is cancelled, the state returns to state 9-E.

In state 9-K, the system control unit 50 captures an image with the focus position locked. Here, the system control unit 50 hides the detection frame 913. Display 918 indicates that imaging is in progress. In this state, operations such as a “stop tracking” operation are unable to be performed. If the imaging operation (SW2) is cancelled, the state returns to state 9-F.

In state 9-L, the system control unit 50 captures an image with the focus position locked. Here, the system control unit 50 hides the tracking frame 914. In this state, operations such as a “stop tracking” operation are unable to be performed. If the imaging operation (SW2) is cancelled, the state returns to state 9-G.

In state 9-M, the system control unit 50 captures an image with the focus position locked. Here, the system control unit 50 hides the tracking frame 915. In this state, operations such as a “stop tracking” operation are unable to be performed. If the imaging operation (SW2) is cancelled, the state returns to state 9-H.

In state 9-N, the system control unit 50 captures an image with the focus position locked. Here, the system control unit 50 hides the AF area frame 916. In this state, operations such as a “stop tracking” operation are unable to be performed. If the imaging operation (SW2) is cancelled, the state returns to state 9-I.

In state 9-O, the system control unit 50 captures an image with the focus position locked. Here, the system control unit 50 hides the tracking frame 917. In this state, operations such as a “stop tracking” operation are unable to be performed. If the imaging operation (SW2) is cancelled, the state returns to state 9-J.

In state 9-a illustrated in FIG. 9B, the system control unit 50 displays icons 901a to 905a indicating setting values and state values. The icon 901a indicates single-point AF with the tracking setting “off”. The icon 902a indicates that the AF operation is one-shot AF. The icon 903a indicates that the object to be detected is a human figure. The icon 904a indicates that the pupil detection is off. The icon 905a indicates that the tracking state is turned off. The system control unit 50 also displays an AF area frame 906a. If a “start tracking” operation is performed in such a state, the state proceeds to state 9-b. If an AF operation (imaging preparation operation [SW1]) is performed, the state proceeds to state 9-f.

In state 9-b, the system control unit 50 tracks the object using a tracking frame 907a. The icon 905a is switched to on. If a “stop tracking” operation is performed in such a state, the state returns to state 9-a. If an AF operation (imaging preparation operation [SW1]) is performed in such a state, the state proceeds to state 9-g. If the object moves in the XY directions of the screen, the state proceeds to state 9-c.

In state 9-c, the system control unit 50 updates a tracking frame 908a to follow the movement of the object. If a “stop tracking” operation is performed in such a state, the state proceeds to state 9-d. If an AF operation (imaging preparation operation [SW1]) is performed, the state proceeds to state 9-h.

In state 9-d, the system control unit 50 displays an AF area frame 909a. If a “start tracking” operation is performed in such a state, the state proceeds to state 9-e. If an AF operation (imaging preparation operation [SW1]) is performed, the state proceeds to state 9-i.

In state 9-e, the system control unit 50 updates a tracking frame 910a to follow the movement of the object. The icon 905a is switched to on. If a “stop tracking” operation is performed in such a state, the state returns to state 9-d. If an AF operation (imaging preparation operation [SW1]) is performed, the state proceeds to state 9-j.

In state 9-f, the system control unit 50 performs one-shot AF using an AF area frame 911a, and locks the focus position. If an imaging operation (SW2) is performed in such a state, the state proceeds to state 9-k. If a “start tracking” operation is performed, the state proceeds to state 9-g. If the AF operation (imaging preparation operation [SW1]) is cancelled, the state returns to state 9-a.

In state 9-g, the system control unit 50 performs one-shot AF using a tracking frame 912a, and locks the focus position. If a “stop tracking” operation is performed in such a state, the state returns to state 9-f. If an imaging operation (SW2) is performed, the state proceeds to state 9-l. If the AF operation (imaging preparation operation [SW1]) is cancelled, the state returns to state 9-b.

In state 9-h, the system control unit 50 performs one-shot AF using a tracking frame 913a, and locks the focus position. If a “stop tracking” operation is performed in such a state, the state proceeds to state 9-i. If an imaging operation (SW2) is performed, the state proceeds to state 9-m. If the AF operation (imaging preparation operation [SW1]) is cancelled, the state returns to state 9-c.

In state 9-i, the system control unit 50 performs one-shot AF using an AF area frame 914a, and locks the focus position. If a “start tracking” operation is performed in such a state, the state proceeds to state 9-j. If an imaging operation (SW2) is performed, the state proceeds to state 9-n. If the AF operation (imaging preparation operation [SW1]) is cancelled, the state returns to state 9-d.

In state 9-j, the system control unit 50 performs one-shot AF using a tracking frame 915a, and locks the focus position. The icon 905a is switched to on. If a “stop tracking” operation is performed in such a state, the state returns to state 9-i. If an imaging operation (SW2) is performed, the state proceeds to state 9-o. If the AF operation (imaging preparation operation [SW1]) is cancelled, the state returns to state 9-e.

In state 9-k, the system control unit 50 captures an image with the focus position locked. Here, the system control unit 50 hides the AF area frame 911a. Display 916a indicates that imaging is in progress. In this state, operations such as a “stop tracking” operation are unable to be performed. If the imaging operation (SW2) is cancelled, the state returns to state 9-f.

In state 9-l, the system control unit 50 captures an image with the focus position locked. Here, the system control unit 50 hides the tracking frame 912a. In this state, operations such as a “stop tracking” operation are unable to be performed. If the imaging operation (SW2) is cancelled, the state returns to state 9-g.

In state 9-m, the system control unit 50 captures an image with the focus position locked. Here, the system control unit 50 hides the tracking frame 913a. In this state, operations such as a “stop tracking” operation are unable to be performed. If the imaging operation (SW2) is cancelled, the state returns to state 9-h.

In state 9-n, the system control unit 50 captures an image with the focus position locked. Here, the system control unit 50 hides the AF area frame 914a. In this state, operations such as a “stop tracking” operation are unable to be performed. If the imaging operation (SW2) is cancelled, the state returns to state 9-i.

In state 9-o, the system control unit 50 captures an image with the focus position locked. Here, the system control unit 50 hides the tracking frame 915a. In this state, operations such as a “stop tracking” operation are unable to be performed. If the imaging operation (SW2) is cancelled, the state returns to state 9-j.

Control Procedure in Case of Servo AF

FIGS. 10A to 10C illustrate a flowchart of control in the case of servo AF. The processes are implemented by the system control unit 50 loading a program stored in the nonvolatile memory 56 into the system memory 52 and executing the loaded program.

In the following flowchart, the processing and control are performed by the system control unit 50.

In step S1001, the system control unit 50 reads a tracking start position from the storage area (nonvolatile memory 56).

In step S1002, the system control unit 50 determines whether a move operation to move the tracking start position is performed. If a move operation is performed (YES in step S1002), the processing proceeds to step S1003. If not (NO in step S1002), the processing proceeds to step S1004. Examples of the move operation in the present exemplary embodiment include a frame movement using the MC 65 or the directional keypad 74, and a frame movement using a touch.

In step S1003, the system control unit 50 updates the tracking start position based on the move operation to move the tracking start position (e.g., from state 8-D to state 8-E).

In step S1004, the system control unit 50 determines whether a tracking start operation is performed. If a tracking start operation is performed (YES in step S1004), the processing proceeds to step S1005. If not (NO in step S1004), the processing proceeds to step S1006. Examples of the tracking start operation in the present exemplary embodiment include the customized button function “start tracking”.

In step S1005, the system control unit 50 detects an object at the tracking start position, determines a main object, and starts tracking. In starting tracking, the system control unit 50 hides the tracking start position (AF area frame) and displays a tracking frame (e.g., from state 8-E to state 8-F).

In step S1006, the system control unit 50 determines whether tracking is continued. If tracking is continued (YES in step S1006), the processing proceeds to step S1007. If tracking is not continued (NO in step S1006), the processing proceeds to step S1008.

In step S1007, the system control unit 50 updates the tracking frame. The system control unit 50 updates the tracking frame to follow the movement of the object (e.g., from state 8-B to state 8-C).

In step S1008, the system control unit 50 determines whether a tracking stop operation is performed. If a tracking stop operation is performed (YES in step S1008), the processing proceeds to step S1009. If not (NO in step S1008), the processing proceeds to step S1010.

In step S1009, the system control unit 50 stops the tracking frame. Here, the system control unit 50 hides the tracking frame and displays the tracking start position (AF area frame). The system control unit 50 here reads the stored tracking start position and sets the tracking start position (e.g., from state 8-C to state 8-D).

In step S1010, the system control unit 50 determines whether an imaging preparation operation is performed. If an imaging preparation operation is performed (YES in step S1010), the processing proceeds to step S1011. If not (NO in step S1010), the processing proceeds to step S1054. An example of the imaging preparation operation in the present exemplary embodiment is the half-pressing of the shutter button 61 (e.g., from state 8-A to state 8-J).

In step S1011, the system control unit 50 determines whether the setting to hold the frame position when tracking is stopped (FIG. 3E) on the menu setting is on. If the setting is on (YES in step S1011), the processing proceeds to step S1027. If the setting is off (NO in step S1011), the processing proceeds to step S1012.

In step S1012, the system control unit 50 determines whether to activate tracking (automatic tracking) based on the tracking setting. The determination criterion is that the imaging standby state transitions to the imaging preparation state when tracking is off and the tracking setting is “on”. If the system control unit 50 determines to activate automatic tracking (YES in step S1012), the processing proceeds to step S1013. If not (NO in step S1012), the processing proceeds to step S1014.

In step S1013, the system control unit 50 detects an object at the tracking start position, determines a main object, and starts tracking. In starting tracking, the system control unit 50 hides the tracking start position (AF area frame) and displays a tracking frame (e.g., from state 8-A to state 8-G).

In step S1014, the system control unit 50 determines whether a move operation to move the tracking start position is performed. If a move operation is performed (YES in step S1014), the processing proceeds to step S1015. If not (NO in step S1014), the processing proceeds to step S1016. Examples of the move operation in the present exemplary embodiment include a frame movement using the MC 65 or the directional keypad 74, and a frame movement using a touch.

In step S1015, the system control unit 50 updates the tracking start position based on the move operation to move the tracking start position (e.g., from state 8-I to state 8-J).

In step S1016, the system control unit 50 determines whether a tracking start operation is performed. If a tracking start operation is performed (YES in step S1016), the processing proceeds to step S1017. If not (NO in step S1016), the processing proceeds to step S1018. Examples of the tracking start operation in the present exemplary embodiment include the customized button function “start tracking”.

In step S1017, the system control unit 50 detects an object at the tracking start position, determines a main object, and starts tracking. In starting tracking, the system control unit 50 hides the tracking start position (AF area frame) and displays a tracking frame (e.g., from state 8-J to state 8-K).

In step S1018, the system control unit 50 determines whether tracking is continued. If tracking is continued (YES in step S1018), the processing proceeds to step S1019. If tracking is not continued (NO in step S1018), the processing proceeds to step S1020.

In step S1019, the system control unit 50 updates the tracking frame. The system control unit 50 updates the tracking frame to follow the movement of the object (e.g., from state 8-G to state 8-H).

In step S1020, the system control unit 50 determines whether a tracking stop operation is performed. If a tracking stop operation is performed (YES in step S1020), the processing proceeds to step S1021. If not (NO in step S1020), the processing proceeds to step S1022.

In step S1021, the system control unit 50 stops the tracking frame. Here, the system control unit 50 hides the tracking frame and displays the original tracking start position (AF area frame).

In step S1022, the system control unit 50 determines whether to perform an AF operation. If the system control unit 50 determines to perform an AF operation (YES in step S1022), the processing proceeds to step S1023. If not (NO in step S1022), the processing proceeds to step S1024.

In step S1023, the system control unit 50 performs an AF operation. Examples of the AF operation in the present exemplary embodiment include a servo operation. In the case of the servo operation, the system control unit 50 performs the servo operation for focus tracking each time.

In step S1024, the system control unit 50 determines whether an imaging operation is performed. If an imaging operation is performed (YES in step S1024), the processing proceeds to step S1025. If not (NO in step S1024), the processing proceeds to step S1026.

In step S1025, the system control unit 50 captures an image. In the present exemplary embodiment, the system control unit 50 captures an image based on the second shutter switch signal SW2 (e.g., from state 8-G to state 8-L).

In step S1026, the system control unit 50 determines whether the imaging preparation state is cancelled. If the imaging preparation state is cancelled (YES in step S1026), the processing proceeds to step S1054. If the imaging preparation state is not cancelled (NO in step S1026), the processing returns to step S1012.

In step S1027, the system control unit 50 turns off a position change flag and an automatic tracking flag to be controlled within the procedure.

In step S1028, the system control unit 50 temporarily stores the tracking start position into the system memory 52. In this procedure, the stored tracking start position is defined as a start position Temp.

In step S1029, the system control unit 50 determines whether to activate tracking (automatic tracking) based on the tracking setting. The determination criterion is that the imaging standby state transitions to the imaging preparation state when tracking is off and the tracking setting is “on”. If the system control unit 50 determines to activate automatic tracking (YES in step S1029), the processing proceeds to step S1030. If not (NO in step S1029), the processing proceeds to step S1032.

In step S1030, the system control unit 50 detects an object at the tracking start position, determines a main object, and starts tracking. In starting tracking, the system control unit 50 hides the tracking start position (AF area frame) and displays a tracking frame (e.g., from state 8-A to state 8-G).

In step S1031, the system control unit 50 turns the automatic tracking flag on.

In step S1032, the system control unit 50 determines whether a move operation to move the tracking start position is performed. If a move operation is performed (YES in step S1032), the processing proceeds to step S1033. If not (NO in step S1032), the processing proceeds to step S1035. Examples of the move operation in the present exemplary embodiment include a frame movement using the MC 65 or the directional keypad 74, and a frame movement using a touch.

In step S1033, the system control unit 50 updates the tracking start position based on the move operation to move the tracking start position (e.g., from state 8-I to state 8-J).

In step S1034, the system control unit 50 turns the position change flag on.

In step S1035, the system control unit 50 determines whether a tracking start operation is performed. If a tracking start operation is performed (YES in step S1035), the processing proceeds to step S1036. If not (NO in step S1035), the processing proceeds to step S1037. Examples of the tracking start operation in the present exemplary embodiment include the customized button function “start tracking”.

In step S1036, the system control unit 50 detects an object at the tracking start position, determines a main object, and starts tracking. In starting tracking, the system control unit 50 hides the tracking start position (AF area frame) and displays the tracking frame (e.g., from state 8-J to state 8-K).

In step S1037, the system control unit 50 determines whether tracking is continued. If tracking is continued (YES in step S1037), the processing proceeds to step S1038. If tracking is not continued (NO in step S1037), the processing proceeds to step S1039.

In step S1038, the system control unit 50 updates the tracking frame. The system control unit 50 updates the tracking frame to follow the movement of the object (e.g., from state 8-G to state 8-H).

In step S1039, the system control unit 50 determines whether a tracking stop operation is performed. If a tracking stop operation is performed (YES in step S1039), the processing proceeds to step S1040. If not (NO in step S1039), the processing proceeds to step S1045.

In step S1040, the system control unit 50 determines whether to temporarily replace the tracking start position with the tracking stop position. If the system control unit 50 determines to replace the tracking start position with the tracking stop position (YES in step S1040), the processing proceeds to step S1042. If not (NO in step S1040), the processing proceeds to step S1041. The present exemplary embodiment proposes control in the case of replacing the tracking start position with the tracking-stopped position. As another exemplary embodiment, the system control unit 50 can change control when a start and stop of tracking are switched each time a button is pressed and when the start and stop of tracking are switched only while the button is pressed. In such a case, if the start and stop of tracking are switched each time the button is pressed (FIG. 4B), the processing proceeds to step S1041. If the start and stop of tracking are switched only while the button is pressed (FIG. 4F), the processing proceeds to step S1042. The processing can branch the other way around. While in the present exemplary embodiment the tracking start position is assumed to be replaced, the tracking start position can be set based on a criterion combined with the setting to hold the tracking stop position in step S1011.

In step S1041, the system control unit 50 stops the tracking frame. Here, the system control unit 50 hides the tracking frame and displays the original tracking start position (AF area frame) (e.g., from state 8-H to state 8-I).

In step S1042, the system control unit 50 sets the center position of the current tracking frame as the tracking start position. This processing is characteristic of the present exemplary embodiment, and intended to place emphasis on the continuity of tracking in the imaging preparation state.

In step S1043, the system control unit 50 stops the tracking frame. Here, the system control unit 50 hides the tracking frame and displays the tracking start position (AF area frame) at the position set in step S1042 (e.g., from state 8-H to state 8-I).

In step S1044, the system control unit 50 turns the automatic tracking flag off. As another exemplary embodiment, the processing of step S1044 can be skipped and the tracking in step S1014 can be clarified to modify control to easy-to-understand specifications.

In step S1045, the system control unit 50 determines whether to perform an AF operation. If the system control unit 50 determines to perform an AF operation (YES in step S1045), the processing proceeds to step S1046. If not (NO in step S1045), the processing proceeds to step S1047.

In step S1046, the system control unit 50 performs an AF operation. Examples of the AF operation in the present exemplary embodiment include a servo operation. In the case of the servo operation, the system control unit 50 performs the servo operation for focus tracking each time.

In step S1047, the system control unit 50 determines whether an imaging operation is performed. If an imaging operation is performed (YES in step S1047), the processing proceeds to step S1048. If not (NO in step S1047), the processing proceeds to step S1049.

In step S1048, the system control unit 50 captures an image. In the present exemplary embodiment, the system control unit 50 captures an image based on the second shutter switch signal SW2 (e.g., from state 8-G to state 8-L).

In step S1049, the system control unit 50 determines whether the imaging preparation state is cancelled. If the imaging preparation state is cancelled (YES in step S1049), the processing proceeds to step S1050. If the imaging preparation state is not cancelled (NO in step S1049), the processing returns to step S1032.

In step S1050, the system control unit 50 determines the state of the automatic tracking flag. If the automatic tracking flag is on (YES in step S1050), the processing proceeds to step S1051. If the automatic tracking flag is off (NO in step S1050), the processing proceeds to step S1052.

In step S1051, the system control unit 50 stops the tracking frame. Here, the system control unit 50 hides the tracking frame and displays the tracking start position (AF area frame) at the position set in step S1042 (e.g., from state 8-G to state 8-A)

In step S1052, the system control unit 50 determines the state of the position change flag. If the position change flag is on (YES in step S1052), the processing proceeds to step S1054 (e.g., from state 8-J to state 8-E). If the position change flag is off (NO in step S1052), the processing proceeds to step S1053.

In step S1053, the system control unit 50 sets the tracking start position at the start position Temp (e.g., from state 8-I to state 8-D).

In step S1054, the system control unit 50 determines whether to end this procedure. If the system control unit 50 determines to end this procedure (YES in step S1054), the processing proceeds to step S1055. If not (NO in step S1054), the processing proceeds to step S1002.

In step S1055, the system control unit 50 stores the tracking start position into the storage area (nonvolatile memory 56). The processing ends.

Control Procedure in Case of One-Shot AF

FIG. 11 is a flowchart illustrating control in the case of one-shot AF. The processes are implemented by the system control unit 50 loading a program stored in the nonvolatile memory 56 into the system memory 52 and executing the loaded program.

In the following flowchart, the processing and control are performed by the system control unit 50.

In step S1101, the system control unit 50 reads the tracking start position (AF area) from the storage area (nonvolatile memory 56).

In step S1102, the system control unit 50 determines whether a move operation to move the tracking start position is performed. If a move operation is performed (YES in step S1102), the processing proceeds to step S1103. If not (NO in step S1102), the processing proceeds to step S1104. Examples of the move operation in the present exemplary embodiment include a frame movement using the MC 65 or the directional keypad 74, and a frame movement using a touch.

In step S1103, the system control unit 50 updates the tracking start position based on the move operation to move the tracking start position.

In step S1104, the system control unit 50 determines whether a tracking start operation is performed. If a tracking start operation is performed (YES in step S1104), the processing proceeds to step S1105. If not (NO in step S1104), the processing proceeds to step S1106. Examples of the tracking start operation in the present exemplary embodiment include the customized button function “start tracking”.

In step S1105, the system control unit 50 detects an object at the tracking start position, determines a main object, and starts tracking. In starting tracking, the system control unit 50 hides the tracking start position (AF area frame) and displays a tracking frame (e.g., from state 9-D to state 9-E, or from state 9-a to state 9-b)

In step S1106, the system control unit 50 determines whether tracking is continued. If tracking is continued (YES in step S1106), the processing proceeds to step S1107. If tracking is not continued (NO in step S1106), the processing proceeds to step S1108.

In step S1107, the system control unit 50 updates the tracking frame. The system control unit 50 updates the tracking frame to follow the movement of the object (e.g., from state 9-B to state 9-C).

In step S1108, the system control unit 50 determines whether a tracking stop operation is performed. If a tracking stop operation is performed (YES in step S1108), the processing proceeds to step S1109. If not (NO in step S1108), the processing proceeds to step S1110.

In step S1109, the system control unit 50 stops the tracking frame. Here, the system control unit 50 hides the tracking frame and displays the tracking start position (AF area frame). The system control unit 50 here reads the stored tracking start position and sets the tracking start position (e.g., from state 9-C to state 9-D)

In step S1110, the system control unit 50 determines whether an imaging preparation operation is performed. If an imaging preparation operation is performed (YES in step S1110), the processing proceeds to step S1111. If not (NO in step S1110), the processing proceeds to step S1123. An example of the imaging preparation operation in the present exemplary embodiment is the half-pressing of the shutter button 61 (e.g., from state 9-A to state 9-F)

In step S1111, the system control unit 50 determines whether a move operation to move the tracking start position is performed. If a move operation is performed (YES in step S1111), the processing proceeds to step S1112. If not (NO in step S1111), the processing proceeds to step S1113. Examples of the move operation in the present exemplary embodiment include a position movement by a centering operation. As another exemplary embodiment, an eight-way operation member can be used to move the position.

In step S1112, the system control unit 50 updates the tracking start position based on the move operation to move the tracking start position.

In step S1113, the system control unit 50 determines whether a tracking start operation is performed. If a tracking start operation is performed (YES in step S1113), the processing proceeds to step S1114. If not (NO in step S1113), the processing proceeds to step S1115. Examples of the tracking start operation in the present exemplary embodiment include the customized button function “start tracking”.

In step S1114, the system control unit 50 detects an object at the tracking start position, and locks a main object. When locking the main object, the system control unit 50 hides the tracking start position (AF area frame) and displays the tracking frame (e.g., from state 9-f to state 9-g).

In step S1115, the system control unit 50 determines whether a tracking stop operation is performed. If a tracking stop operation is performed (YES in step S1115), the processing proceeds to step S1116. If not (NO in step S1115), the processing proceeds to step S1117.

In step S1116, the system control unit 50 unlocks the main object. When unlocking the main object, the system control unit 50 also turns off the internal tracking state (e.g., from state 9-g to state 9-f).

In step S1117, the system control unit 50 determines whether to perform an AF operation. If the system control unit